The TOFFEE Project
The TOFFEE Project

Updates :: Introducing TOFFEE-DataCenter

Written by: Kiran Kankipati - Published: 04-Aug-2016


Since past couple of days I was having sleepless nights as I was working on a new TOFFEE WAN Optimization software variant called as TOFFEE Data-Center. Unlike existing TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

The new upcoming TOFFEE Data-Center will have basic minimal kernel module plus TOFFEE user-space components. The entire packet processing is done within user-space. And these modules can be spawned according to the load, and system's hardware capabilities. In a typical scenario you can have 10-100 such threads executing simultaneously at any given point of time. If due to any reason if one thread crashes/fails, the other threads will continue to operate. And if required based on the load, new threads can be spawned dynamically. With high-speed load balancing systems, you can build a complete WAN Optimization hardware cluster(s) based on TOFFEE Data-Center variant.

Here is an example of TOFFEE Data-Center deployment in which TOFFEE Data-Center is deployed in one more many servers with optional load-balancers. Click HERE to know more about TOFFEE deployment scenarios and topology.
TOFFEE-DataCenter WAN Optimization

Initial Prototyping and Feasibility tests: A basic prototype and PoC (proof of concept) software is built to test this idea. With the prototype various scenarios are tested with different hardware platforms such as low-end mini-PC, an extreme Core i7 Gaming Desktop, and Intel Xeon server(s). With Xeon Server and Core i7 we can process up to 1-Gigabit Network speeds thus achieving almost wire-speed performance everything within software layer. Making it to work smoothly within software layer is a challenge but it is required for VM, SDN based WAN Optimization device builds.

Software Development standpoint: Unlike the existing TOFFEE, since the new TOFFEE Data-Center is user-space centric, I can do code build, compile, test, debug, bug-fix cycles at much higher rates. Since the architecture is discrete, in future any new components can be plugged in it on demand basis with/without significant code changes. TOFFEE Data-Center (like TOFFEE) can also be used with any hardware compression/acceleration cards. This way you can offload some amount of packet processing load and improve overall system performance.

TOFFEE Data-Center for VM/SDN/Cloud Applications: The TOFFEE Data-Center with its modular architecture is well suited for VM based builds, SDN and Cloud deployments. TOFFEE Data-center is highly portable code which makes it easier to port for any hardware platforms such as ARM, MIPS besides x86.

Hardware Requirements TOFFEE vs TOFFEE Data-Center: TOFFEE needs a good CPU with excellent per-core performance. Traditionally Linux Kernel itself (kernel space modules) is not good at scaling in multi-core/multi-cpu CPU platforms. Instead the user-space apps in a Linux System is good at scaling in multi-core/multi-cpu CPU scenarios. This is the main drawback which can degrade the performance of TOFFEE. But TOFFEE Data-Center is modular so it prefers average single core CPU performance, but more CPU cores since it works in user-space and the load is shared across multiple TOFFEE Data-Center user-space computing modules.

Release schedule of the new upcoming TOFFEE Data-Center: TOFFEE Data-Center is just started (as on 4-Aug-2016) and its a huge project. Once a basic, stable version is developed, as a part of initial first phase the same will be released soon once it is mature and stable. Here is my Youtube VLOG of the same:

Watch Video: Introducing TOFFEE-DataCenter

* Click the image above to watch this video on Youtube ↗



Suggested Topics:


TOFFEE-DataCenter - WAN Optimization
 Upgrading Ubuntu 17.10 to 18.04 via TOFFEE-DataCenter WAN Optimization Screenshots ↗
05-Jun-2018


 Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
13-Aug-2017


 TOFFEE-DataCenter Live Demo with Clash of Clans game data - 30-Aug-2016 ↗
30-Aug-2016


 TOFFEE-DataCenter - First Live Demo and software development - Update: 26-Aug-2016 ↗
26-Aug-2016


 TOFFEE-DataCenter WAN Optimization software development - Update: 19-Aug-2016 ↗
19-Aug-2016


 TOFFEE-DataCenter WAN Optimization software development - Update: 13-Aug-2016 ↗
13-Aug-2016


 Introducing TOFFEE-DataCenter ↗
04-Aug-2016



Categories
 TOFFEE-DataCenter - WAN Optimization ↗


 TOFFEE - WAN Optimization ↗


 TOFFEE-Mocha - WAN Emulator ↗


 TOFFEE-Fudge - Network Packet Generator ↗


 TOFFEE-Butterscotch - Save and Optimize your Internet/WAN bandwidth ↗


 

Recommended Topics:




Featured Educational Video:
Watch Video: Linux Kernel sk_buff data-structure - part1 - Introduction

* Click the image above to watch this video on Youtube ↗


Skype VOIP Data - WAN Acceleration:
  > reduce/eliminate Jitter
  > no more call drops
  > accelerate any VOIP (including long-distance Skype calls)



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server



The TOFFEE Project - v9.20 :: Updated: 07-Jul-2018 :: © 2018 :: Author: Kiran Kankipati
Your IP: 54.92.163.188 :: Browser: CCBot/2.0 (http://commoncrawl.org/faq/)