The TOFFEE Project
The TOFFEE Project

Documentation :: TOFFEE with Hardware Compression and Decompression Accelerator Cards

Written by: Kiran Kankipati - Published: 30-Jun-2016


You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.

Here is the TOFFEE system architecture with and without hardware accelerator card (i.e Hardware offload). Hardware offload will greatly reduce the load on general purpose CPU (which is your software/OS layer) and the core data optimization operation such as loss-less compression (sometimes even encryption) is done within a dedicated Hardware Accelerator card (or chip) as shown below.
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]

In this case TOFFEE will work as an WAN Optimization framework. With this framework you can architect your entire commercial WAN Optimization product series. You need to modify TOFFEE Linux kernel modules (and APIs) so that it no longer choose kernel's LZ77, LZO or LZ4 software compression libraries (which is CPU bound), instead point to the hardware accelerator card vendor provided kernel's driver/library APIs. This makes packet data compression within TOFFEE Linux Kernel module CPU bound to dedicated co-processor hardware compression accelerator card bound.

It is a well known fact that Linux Kernel's Kernel modules are not great at scaling with multiple CPU Processor Cores. So in a systems architecture point of having more CPU cores in a TOFFEE WAN Optimization device gives no significant advantage. The per-core CPU performance is what required for a workload like TOFFEE packet data optimization. So if architect a high-end WAN Optimization device you need to consider hardware acceleration offload if feasible.

For example: Here is a general purpose AHA AHA363PCIE0301G 5Gbs GZIP Compression/Decompression Accelerator Card. Typical applications (or use-cases) of this card could be Storage Arrays, Load Balancers, WAN Optimization, Web Servers, Data Analytics, etc.
Comtech AHA AHA363PCIE0301G 5Gbs GZIP Compression/Decompression Accelerator Card
Image courtesy/link: https://images-na.ssl-images-amazon.com/images/I/61kMl1v4BmL._SL1500_.jpg

References:



Suggested Topics:


TOFFEE - WAN Optimization

 TOFFEE (and or TOFFEE-DataCenter) deployment in SD-WAN Applications ↗
26-Mar-2018


 TOFFEE (and or TOFFEE-DataCenter) deployment with VPN devices ↗
15-Nov-2017


 TOFFEE (and or TOFFEE-DataCenter) deployment with web-proxy cache ↗
15-Nov-2017


 TOFFEE (and or TOFFEE-DataCenter) deployment in Large Infrastructure and or ISP Networks ↗
15-Nov-2017


 TOFFEE (and or TOFFEE-DataCenter) optimized Satellite (inflight/marine/defense) ISP Networks ↗
15-Nov-2017


 TOFFEE (and or TOFFEE-DataCenter) optimized Mobile Wireless Backhaul Networks ↗
15-Nov-2017


 TOFFEE (and or TOFFEE-DataCenter) optimized Wireless Mesh-Networks - B.A.T.M.A.N [open-mesh.org (Open Mesh)] ↗
15-Nov-2017


 TOFFEE Download :: TOFFEE-1.1.70-1-portable ↗
10-Feb-2017


 VPN Network Optimization via TOFFEE WAN Optimization ↗
24-Jan-2017


 TOFFEE Benchmarks :: TOFFEE-1.1.28 ↗
02-Jul-2016


 TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
30-Jun-2016


 DIY TOFFEE WAN Optimization Device with Intel Celeron Mini PC ↗
06-Jun-2016


 TOFFEE Documentation :: TOFFEE-1.1.24-3-rpi2 ↗
01-Jun-2016


 TOFFEE deployment topology guide ↗
08-May-2016


 TOFFEE hardware selection guide ↗
03-May-2016


 TOFFEE License ↗
24-Jan-2016



Categories

 TOFFEE-DataCenter - WAN Optimization ↗


 TOFFEE - WAN Optimization ↗


 TOFFEE-Mocha - WAN Emulator ↗


 TOFFEE-Butterscotch - Save and Optimize your Internet/WAN bandwidth ↗


 

Recommended Topics:




Featured Educational Video:
Watch Video: Linux Kernel skbuff data-structure - part13 - Parsing skb ip-packet

* Click the image above to watch this video on Youtube ↗


Skype VOIP Data - WAN Acceleration:
  > reduce/eliminate Jitter
  > no more call drops
  > accelerate any VOIP (including long-distance Skype calls)



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server



The TOFFEE Project - v9.20 :: Updated: 07-Jul-2018 :: © 2018 :: Author: Kiran Kankipati
Your IP: 54.161.40.41 :: Browser: CCBot/2.0 (http://commoncrawl.org/faq/)