The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


RESEARCH 》 Optimization of network data (WAN Optimization) at various levels

WAN Network data can be optimized at various levels depending upon the network applications, protocols, topology and use-cases. So the amount of data you can optimize will depend on the strategy you choose to optimize.

Network Packet level optimization: You can optimize your network data down to individual packets. This may be useful to optimize discrete network data such as VoIP and streaming networking applications. So depending on your network you can do frame level optimization in case if it is a Layer-2 switched network something like MPLS/VPLS scenarios. And in case it is a IP based routed networks you can do IP packet level optimization. So that the IP-header is intact where-as its other protocol headers and the payload is optimized. Hence packet level optimization suits for discrete network data and corresponding network applications.
Network Packet level network data WAN Optimization

Session level optimization: Session level (or session based) optimization is suited for complete/full sessions bound by a network connection. For example TCP-connection. A remote MySQL or Oracle database access involves a TCP-connection (or a session). So in this case we are not talking about discrete packet level access (although a session will always comprise multiple packet transfers to and fro) and we are not talking about individual file-level access, instead it is a session-level bulk data transfers. In this case we can employ different network optimization strategy so that the entire session can be optimized.
Network Session level network data WAN Optimization

File level optimization: Last but not least a file-level optimization involves a typical file-download/file-upload scenario such as HTTP, FTP and so on. In this case in general even before sending across the wire we can do lossy (and lossless) compression of these files depending on its contents. But when it is being transferred across the network we can employ a network optimization strategy where an entire file transfer is optimized. We can also implement both above discussed techniques such as network packet-level and session-level to optimize file-level network data transfer. Some of the examples which comes in this category are CDN networks, HTTP Cache Proxy (such as Squid-Cache) and so on.
Network File level network data WAN Optimization

Case study :: Dolby Servers in movie theaters: Movie theaters these days get digitized extremely high-quality movie files from film producers/distributor channels. Since these files are so huge they are transferred via high-speed wire (fibre-optic) networks. But in case if the movie theaters lack high-speed network connectivity then they ship these movie copies on a regular computer hard-drive. This is a good case study and use-case where file-level network data optimization can be deployed.
Here are some interesting videos on Digital Cinema movie servers and projection technology:


Here is my detailed video of the same:

In case if you are having a company and if you are looking for ways to optimize your network, performance tune-up and or building network optimization product(s) (which may or may not include porting/integrating TOFFEE on to your product), in that case I can offer my technical consultation services. If you are interested you can contact me for the same.



Suggested Topics:


WAN Optimization and Network Optimization

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016 ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016

First TOFFEE Code Release ↗
Saturday' 13-Mar-2021
I started working on the new TOFFEE project (which is the fork of my earlier TrafficSqueezer open-source project) starting from 1st January 2016 onwards. Ever since I was busy in research and altering certain old features so that it is more minimal than TrafficSqueezer, a more focused agenda, deliver refined code and a broader vision. I have lined up more things to follow in the upcoming months. I want to focus about all aspects of WAN communication technologies not just on core WAN Optimization research and technology.

Introducing TOFFEE-DataCenter ↗
Saturday' 13-Mar-2021
TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

Setting up a WAN Emulator within VirtualBox ↗
Saturday' 13-Mar-2021

MySQL Database Network Data - WAN Acceleration ↗
Saturday' 13-Mar-2021
Here is a quick demo of TOFFEE WAN Optimization optimizing MySQL Data transfers of a MySQL Client to Server Remote Access.

My Lab Battery Purchase and Service logs for Research ↗
Saturday' 13-Mar-2021
Here is a complete log of my lab battery purchase, service record which I maintain in Google drive. These I use for my home (or my family generic use) as well as a part of my home lab. I maintain a detailed log this way to monitor the failure rate of these batteries. This will allow me to select a specific brand/model which has higher success rate and to monitor any premature failure/expiry. The service log helps me to monitor and schedule the next service routine so that I can maintain these batteries in tip-top condition.



TOFFEE-Mocha - WAN Emulator :: TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso ↗
Saturday' 13-Mar-2021
Download TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso via Google Drive share: Live bootable x86-64 Debian Stretch 9.5 with light-weight LXDE UI ISO (includes source-code): TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso You can find the source tar-ball in the /root folder. To know more about the project kindly refer TOFFEE- Mocha: News and Updates - Documentation. To know more about current specific release, objectives, features, release notes/updates, quick demo and future road-map, you can watch my video below.

TOFFEE Benchmarks :: TOFFEE-1.1.28 ↗
Saturday' 13-Mar-2021
Here is the TOFFEE WAN Optimization benchmarks of the TOFFEE version: TOFFEE-1.1.28. This is the current TOFFEE development version till date (2-Jul-2016). This is a HPC TOFFEE variant meant for high-end custom build servers and high-end desktops (i.e High Performance Computing a.k.a HPC). TOFFEE built this way often needs customized kernel compilation and build such as processor specific and hardware specific tune-ups since it is highly CPU intensive (if not offloaded via Hardware Accelerator Cards).

TOFFEE-DataCenter packet packaging feature for WAN Optimization ↗
Saturday' 13-Mar-2021

Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016 ↗
Saturday' 13-Mar-2021
Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Luckily I have the most recent backup of the entire website.



Featured Educational Video:
Watch on Youtube - [89//1] B.E and M.E Final Year Projects - Form your Team ↗

The TOFFEE Project :: TOFFEE-DataCenter :: WAN Optimization ↗
Saturday' 13-Mar-2021
The TOFFEE Project :: TOFFEE-DataCenter :: Linux Open-Source WAN Optimization

Advantages of CDN - Content Delivery Networks or Content Distribution Networks ↗
Saturday' 13-Mar-2021

IP Header Compression in WAN Links and TOFFEE-DataCenter WAN Optimization ↗
Saturday' 13-Mar-2021

TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
Saturday' 13-Mar-2021
You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.




Bufferbloat in a Networking Device or an Appliance ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server