The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


RESEARCH 》 Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016

Its been a roller-coaster month (the entire Sep-2016), if you understand and believe in astrology you may well know the reason why. There are couple of eclipses and then there is the Mercury retrograde. Mercury retrograde started around in the month of Aug-30th and it was straight by around Sep-22-25th-2016. If there is a Mercury retrograde we need to be prepared to face any sort of equipment damage, equipment breakdown, downtime, loss of data, hard-disk corruption and so on. And coincidentally we can see there are lot of Samsung's exploding Galaxy Note 7s and exploding Samsung Washing-machine incidents.

Strangely I too had an issue with the entire The TOFFEE Project website (on 25-Sep-2016). Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Once I communicated with them they requested me to authorize so that they can restore the database from their existing backups. They informed me that they take backups at specific intervals. But no one is sure if that includes recent periodic changes I did in the website.

Luckily I have the most recent backup of the entire website. And just couple of days before this downtime I did couple of minor changes and I forgot to take the full site backup after this change. Luckily this change is trivial. So I requested them to ignore my request. And I gone ahead and restored the Joomla database myself from my own snapshot/backup which I had it in my NAS. From that moment I decided I am done with Joomla. I need to move away from Joomla to non-Joomla The TOFFEE Project website.

And in case if you guys are using Inmotionhosting hosting, then at any given point in time they have this great page http://status.inmotionhosting.com. This shows the live status of the Inmotionhosting. If there is any network or server issue they will list here. And before you contact their customer support you can once check the status of your hosted server here. In most cases they may be well aware of this situation/issue and may display over here.
Live Status Inmotionhosting

Moving away from Joomla: The site on that day is completely down for around 12-hours. Since I am anyway thinking about building my own CDN, this incident is a great learning curve. Joomla is great in terms of managing small to medium website(s). But since Joomla manages your content in the database it is an added stress to the server for each page request. And if there is an issue with the database, the site will completely vanish in a blink of an eye. As it happened in my case too. And during this time it will show a nasty mysql connect issue error which looks embarrassing and ugly. And this happens if there is excess load on the server or the database engine.

Besides it is also cumbersome in Joomla managing additional components such as customized tables, scripts, frames, etc. There are workarounds, but it is often inflexible, redundant and cumbersome. And this is the case happened to me while I was inserting Google Adsense ADs. The ADs are appearing out of the article boundary in smart-phones and tabs especially in the portrait mode. I got a warning from the Google Adsense team about it. But I was completely clueless how to solve this weired issue in Joomla. Luckily I found a solution that there are these Responsive ADs which addresses this problem. Finally after I did changes things started looking better. Apart from this there are also issues in case if you are looking for any extensive customization in terms of managing your article categories, etc. Not that they are impossible in Joomla, but they are tricky to do so and you need to repeat these steps all over again for each article/category.

Joomla is troublesome when you are building your own CDN too. Since you cannot extensively control the dynamic links/resources/etc. However if you purchase third-party CDN services, by installing Joomla extensions/plug-ins you can deploy over a CDN. But it is still tricky and challenging. In my case it is out of question. So this is also one of the reasons I took a decision to move away from Joomla and build my own PHP-based website from scratch.

Screenshot of old The TOFFEE Project website built with Joomla:
Screenshot of old The TOFFEE Project website built with Joomla

and as you know here is the screenshot of the The TOFFEE Project website built from scratch with PHP:
Screenshot of old The TOFFEE Project website built from scratch with PHP

While this transition I have also changed the Logo and the theme from Brown to vibrant Orange. With this change the website looks spacious, dynamic, vibrant, and the orange theme allows the website links stand out unlike the old brown theme links. Since it is entirely custom written website it is easy in future to write further automated scripts to spread the website (contents/resources) on a custom built CDN infrastructure. We can load-share, redirect/point images/resources to different dedicated CDN node(s), if the main website is facing glitches, we can redirect to different CDN node(s). We can host multiple CDN nodes on multiple web-hosting provider servers. We can even modify the DNS-entry to point to a different hosting server whenever it is needed or if the main site (hosting server) is down.

Here is my live video log of the same:



Suggested Topics:


Generic CDN


Building my own CDN

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016 ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016

TOFFEE (and TOFFEE-DataCenter) optimized Wireless Mesh-Networks - B.A.T.M.A.N [open-mesh.org (Open Mesh)] ↗
Saturday' 13-Mar-2021
TOFFEE/TOFFEE-DataCenter can be used to optimize Ad-Hoc Mobile Wireless Mesh-Networks. To learn more about the same here are some references: B.A.T.M.A.N. - https://en.wikipedia.org/wiki/B.A.T.M.A.N. Mobile ad hoc network (MANET) - https://en.wikipedia.org/wiki/Mobile_ad_hoc_network Wireless ad hoc network (WANET) - https://en.wikipedia.org/wiki/Wireless_ad_hoc_network open-mesh.org (Open Mesh) Wiki - https://www.open-mesh.org/projects/open-mesh/wiki

WAN Optimization iPhone and Android - Mobile App ↗
Saturday' 13-Mar-2021

TOFFEE DataCenter WAN Optimization - Google Hangouts demo and VOIP Optimization ↗
Saturday' 13-Mar-2021
TOFFEE DataCenter WAN Optimization - Google Hangouts demo and VOIP Optimization

TOFFEE WAN Optimization software development, roadmap, live-demo - Update: 06-Nov-2016 ↗
Saturday' 13-Mar-2021
Here are some of the screenshots of the new upcoming TOFFEE WAN Optimization release and live demo.

TOFFEE Documentation :: TOFFEE-1.1.24-3-rpi2 ↗
Saturday' 13-Mar-2021
Here is my VLOG Youtube video of the same which includes details about version release notes, future road-map and so on. The TOFFEE release is highly optimized and customized for hardware platforms such as x86-64 based Intel NUC and other Intel mobile computing platforms such as laptops and so on. This version (or release) is not suited and so not recommended to be used for high-end desktop and server hardware platform.



First TOFFEE-Mocha Code Release ↗
Saturday' 13-Mar-2021
TOFFEE-Mocha is my dream project which I thought working on it since several years. I want to make a WAN emulation software which is straight forward and simple to use. I used tc scripts along with iptables for testing my TOFFEE (and TrafficSqueezer before TOFFEE) and I am not quite satisfied with the same. As one can understand these scripts are not meant for WAN emulation.

TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
Saturday' 13-Mar-2021
You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.

Power consumption of my Home Lab devices for research ↗
Saturday' 13-Mar-2021
Here is my power-consumption measurements of various devices deployed within my home lab. I measured via my kill-a-watt sort of power-meter which is fairly reliable and accurate. I checked its accuracy with various standard load such as Philips LED laps and other constant power-consuming devices to make sure that the power-meter is precise.

TOFFEE (and TOFFEE-DataCenter) deployment in Large Infrastructure and or ISP Networks ↗
Saturday' 13-Mar-2021
Large Infrastructure or ISP setup: In case if you are an ISP and interested in deploying a large customer WAN Optimized network or an add-on enhanced (WAN Optimized) network for select few customers, then you can deploy something as shown below. Although this case is not meant for hobby/DIY users. This is a feasible solution for high-end professional application and the same can be deployed.



Featured Educational Video:
Watch on Youtube - [8613//1] x254 Kernel Init Code without Kernel Module - Kernel Programming Tip #linode ↗

TOFFEE-DataCenter a TOFFEE variant for Data Center applications ↗
Saturday' 13-Mar-2021

TOFFEE-DataCenter WAN Optimization software development - Update: 13-Aug-2016 ↗
Saturday' 13-Mar-2021
Earlier the TOFFEE is intended to work on IoT devices, Satellite Networks, branch office/SOHO deployments. In most cases the users may deploy just one or couple of TOFFEE devices per site. But in the case of TOFFEE-DataCenter, users can scale-up deploying the same in multiple servers in a sort of distributed cluster computing scenario. Besides the core TOFFEE-DataCenter components (such as packet processing engine/framework), I need to do lot of changes in its Graphical User Interface (GUI) too to address these new requirements.

Live demo - Data Transfer - High bandwidth to Low bandwidth ↗
Saturday' 13-Mar-2021
I always wanted to do some real experiments and research on packet flow patterns from High-bandwidth to Low-bandwidth networks via networking devices. This is something can be analyzed via capturing Network stack buffer data and other parameters, bench-marking, and so on. But eventually the data-transfer nature and other aspects is often contaminated due to the underlying OS and the way Network stack is implemented. So to understand the nature of packet flow from Higher to Lower bandwidth and vice-versa such as Lower to higher bandwidth, I thought I experiment with various tools and things which physically we can observe this phenomena.

Network MTU research and optimization of WAN Links ↗
Saturday' 13-Mar-2021
Network MTU research and optimization of WAN Links



Watch on Youtube - [1888//1] Deep Space Communication - Episode1 - Introduction ↗

TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server