TOFFEE项目
文档更新影片研究下载赞助商联系


RESEARCH 》 A study on Deep Space Networks (DSN)

When you are dealing Deep Space Networks (DSN) one among the most challenging parts is the Interplanetary distances and communicating data across such vast distances. This is where we are not dealing with common Internet type traffic such as HTTP/FTP/VoIP/etc but it is completely different when it comes to DSN so far. So optimizing data in DSN becomes mandatory. For example if you think one of the Mars Rovers, they have used LZO lossless compression. Although they do to an extent lossy compression on images shot by these space-probes at times they we may also need high-resolution detailed high-quality images. And sometimes it is not just photos sent back to the earth, at times the space probes may also report their health status, keep alive messages as well transmit the scientific research data such as data recorded in various sensors situated on-board.

Although we got space probes across the space and ISS (International Space Station) orbiting over Earth, we do not have a scenario yet something like human colonies/bases on Moon or Mars and other planets. Eventually when such things happen in around 2020-2030 or so as the way NASA and scientists predict, DSN is going to be a case where more private companies may offer their solutions. But before that we need to still solve some of the fundamental data communication challenges involved in DSN. This is on of the fields which I am actively involved since a decade.

Unlike here on Earth upgrading a piece of hardware or communication technology is just impossible to do on a space probe which may exist millions of miles away from Earth. This also makes this technology evolve quite slowly unlike Earth bound communication technologies such as Mobile communications, Satellite networks and so on. For further complete coverage of this topic kindly refer my below detailed video titled Deep Space Communication - Episode1.

Understanding Communication Speeds: Most DSN networks are radio-wave signal based and not light (photonic) based communication. Radio waves do not travel at the speed of light. It is also one of the reason for the slow-down of the DSN unlike ground or earth bound fibre optic links since in this case data travels almost (since the medium is not vacuum and speed of light depends on the medium) at the speed of light. Before we imagine network speeds in DSN, let us understand an ideal situation of speed of light between two points in space:

Distance Speed of Light
Earth <> Moon1.5 seconds
Earth <> Mars4 minutes (240 seconds)
Earth <> Sun8 minutes (480 seconds)
Earth <> Jupiter30 minutes (1800 seconds)
Earth <> Saturn1 hour (3600 seconds)
Earth <> Neptune4 hours (14400 seconds)
Earth <> Pluto4.6 hours (16560 seconds)

NOTE: Since we compute network speeds often in bits/sec (and latency in nano-seconds and milli-seconds), in the above chart I am converting everything in seconds to understand the scale.

So based on the above chart now we can understand the scale of complexity in DSN. This underscores a fundamental limitation of physics !

Communication Protocols for DSN: For DSN a complete new set of protocols are defined which is SCP (stands for Space Communications Protocol). There are various RFCs which are defined which is called as SCPS (where S stands for Specifications). There are various variants under SCPS are defined such as SCPS-FP, SCPS-TP, SCPS-SP and SCPS-NP. The biggest difference you may find in DSN is that the delay involved due to inter-planetary distances. So based on the distance you may experience communication delays, loss of packets, etc. Say for example if you think a successful connection is established (for example a TCP session/connection), you may have to-and-fro keep alive acknowledgement packets exchanged every few milliseconds. But whereas in a case of DSN you may experience this happening every few minutes or every few hours. So that is how bizarre it is. Although there is no packet exchanges happening in few minutes or hours you should understand this is due to vast distances involved.

These SCPS specifications are defined by a committee called as CCSDS (stands for Consultative Committee for Space Data Systems). This is a body which is formed as per collaborative effort of various space agencies across the world. An Internet spanning across multiple planets is termed as IPN (stands for Interplanetary Network or in short InterPlanet). For further complete coverage of this topic kindly refer my below detailed video titled Deep Space Communication - Episode2.

Lossless Compression Algorithms for DSN: A specific set of tailor made algorithms are required for space communications unlike the ones which are used in communications here on Earth. They have to be light-weight and at the same time super-efficient and should have least processing latencies. The communication data could be just anything such as scientific research data collected via space probe sensors or it could be hi-resolution photos sent back to earth or it could be commands sent to these probes via ground control crew. I have done extensive research on this for almost more than a decade on various lossless compression algorithms. This is a case where we are dealing optimizing real-time data. This is not a passive file compression something like creating a tar-ball or some zipfile. This is a case you are sending and receiving packets continuously and you are processing them in real-time.

NASA have their own lossless compression variants and often they are customized. One of the well known algorithms which NASA uses is the LOCO-I (stands for Low Complexity Lossless Compression) which is mainly meant for compressing images. LOCO-I is a kind of lossless compression variant of JPEG. Which is why it is also can be sometimes called as JPEG-LS (stands for JPEG-Lossless). Based on LOCO-I NASA did hardware based solution which is FPGA-LOCO. Since it is hardware based, it is good in performance, reliability and extremely energy efficient.

Apart from this CCSDS have their own variant of RICE lossless compression algorithm. For further complete coverage of this topic kindly refer my below detailed video titled Space Lossless Compression.

References:

NASA:

Wikipedia:

Other:



Suggested Topics:


WAN Optimization and Network Optimization

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


推荐主题:

My sample Wireshark packet capture files for research ↗
Saturday' 13-Mar-2021
I have a huge repository (or collection) of sample Wireshark packet capture files for reference. I use them extensively for research and development of TOFFEE as well to understand various protocol PDUs and protocol standards. I personally collected various test captures via Wireshark during my test and experimental research setup during the course of TOFFEE development. Say if you are a student and learning Networking and or say VoIP data and VoIP packets, you can analyse my VoIP sample Wireshark captures. Or in other case assume you are doing some quick research (or development) and want to refer few handful of VoIP packets then you can download and analyse my sample packet capture files.

Power consumption of my Home Lab devices for research ↗
Saturday' 13-Mar-2021
Here is my power-consumption measurements of various devices deployed within my home lab. I measured via my kill-a-watt sort of power-meter which is fairly reliable and accurate. I checked its accuracy with various standard load such as Philips LED laps and other constant power-consuming devices to make sure that the power-meter is precise.

Introducing TOFFEE-DataCenter ↗
Saturday' 13-Mar-2021
TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

Network Latency and Bandwidth Assessment - for Network Admins and Infrastructure Architects ↗
Saturday' 13-Mar-2021

TOFFEE (and TOFFEE-DataCenter) optimized Satellite (inflight/marine/defense) ISP Networks ↗
Saturday' 13-Mar-2021
TOFFEE Optimized Satellite ISP Network: TOFFEE/TOFFEE-DataCenter can be used to optimize Satellite Networks (Satellite based Internet Networks, VoIP, Data, private leased-links) as shown. Ground station transponders can be connected via array of TOFFEE Devices and in the remote CPE can have dedicated or inbuilt TOFFEE with which you can establish a WAN Optimized Satellite Network Tunnel as shown.

Introducing TOFFEE-Fudge - Network Packet Generator ↗
Saturday' 13-Mar-2021
TOFFEE Fudge is a simple intuitive Network Packet Generator which can be used to create custom test synthetic Network Packets and can be used in various applications such as networking research, network infrastructure troubleshooting, ethical hacking, as a network software development tool and so on.



Demo TOFFEE-DataCenter WAN Optimization VM Test Setup ↗
Saturday' 13-Mar-2021

Power consumption of my Home Lab devices for research ↗
Saturday' 13-Mar-2021
Here is my power-consumption measurements of various devices deployed within my home lab. I measured via my kill-a-watt sort of power-meter which is fairly reliable and accurate. I checked its accuracy with various standard load such as Philips LED laps and other constant power-consuming devices to make sure that the power-meter is precise.

TOFFEE-Butterscotch Bandwidth saver software development - Update: 28-Oct-2016 ↗
Saturday' 13-Mar-2021
Here is my first software development update of TOFFEE-Butterscotch. In my first TOFFEE-Butterscotch news update I have introduced about TOFFEE-Butterscotch research, project specifications, use-cases, etc. Introducing TOFFEE-Butterscotch Alerts: These are simple packet counters which corresponds to the filter type. For example if the incoming TCP-SYN packets are blocked then its corresponding alert counter will increment whenever such a packet arrives and gets filtered (dropped).

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.14-1-rpi2 - Raspberry Pi WAN Emulator ↗
Saturday' 13-Mar-2021



Featured Educational Video:
在YouTube上观看 - [171//1] 169 Q&A - Add additional HardDrive or storage space in Linux VirtualBox VM ↗

TOFFEE-Butterscotch Bandwidth saver software development - Update: 17-Nov-2016 ↗
Saturday' 13-Mar-2021
Here is my second software development update of TOFFEE-Butterscotch. In the previous update (28-Oct-2016) I discussed about the Alerts, etc. Whereas in my first TOFFEE-Butterscotch news update I have introduced about TOFFEE-Butterscotch research, project specifications, use-cases, etc.

TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
Saturday' 13-Mar-2021
You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.

YouTube Video Network Traffic Optimization - WAN Optimization Demo ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.32-1-x86_64 and TOFFEE-Mocha-1.0.32-1-i386 ↗
Saturday' 13-Mar-2021




A study on WAN Optimization Techniques ↗
Saturday' 13-Mar-2021
There are various techniques with which one can optimize their WAN Network Data. Any long distance communication can be considered as WAN Network. A decade ago any network connecting two countries, considered as a WAN network, and a network within a city as MAN and soon. But these days in general any long distance communication is considered as WAN Network. Such as your Mobile communication networks, Satellite networks, Space Networks (Deep space networks), Trans-Atlantic cable networks, etc.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server