The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


RESEARCH 》 Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016

Its been a roller-coaster month (the entire Sep-2016), if you understand and believe in astrology you may well know the reason why. There are couple of eclipses and then there is the Mercury retrograde. Mercury retrograde started around in the month of Aug-30th and it was straight by around Sep-22-25th-2016. If there is a Mercury retrograde we need to be prepared to face any sort of equipment damage, equipment breakdown, downtime, loss of data, hard-disk corruption and so on. And coincidentally we can see there are lot of Samsung's exploding Galaxy Note 7s and exploding Samsung Washing-machine incidents.

Strangely I too had an issue with the entire The TOFFEE Project website (on 25-Sep-2016). Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Once I communicated with them they requested me to authorize so that they can restore the database from their existing backups. They informed me that they take backups at specific intervals. But no one is sure if that includes recent periodic changes I did in the website.

Luckily I have the most recent backup of the entire website. And just couple of days before this downtime I did couple of minor changes and I forgot to take the full site backup after this change. Luckily this change is trivial. So I requested them to ignore my request. And I gone ahead and restored the Joomla database myself from my own snapshot/backup which I had it in my NAS. From that moment I decided I am done with Joomla. I need to move away from Joomla to non-Joomla The TOFFEE Project website.

And in case if you guys are using Inmotionhosting hosting, then at any given point in time they have this great page http://status.inmotionhosting.com. This shows the live status of the Inmotionhosting. If there is any network or server issue they will list here. And before you contact their customer support you can once check the status of your hosted server here. In most cases they may be well aware of this situation/issue and may display over here.
Live Status Inmotionhosting

Moving away from Joomla: The site on that day is completely down for around 12-hours. Since I am anyway thinking about building my own CDN, this incident is a great learning curve. Joomla is great in terms of managing small to medium website(s). But since Joomla manages your content in the database it is an added stress to the server for each page request. And if there is an issue with the database, the site will completely vanish in a blink of an eye. As it happened in my case too. And during this time it will show a nasty mysql connect issue error which looks embarrassing and ugly. And this happens if there is excess load on the server or the database engine.

Besides it is also cumbersome in Joomla managing additional components such as customized tables, scripts, frames, etc. There are workarounds, but it is often inflexible, redundant and cumbersome. And this is the case happened to me while I was inserting Google Adsense ADs. The ADs are appearing out of the article boundary in smart-phones and tabs especially in the portrait mode. I got a warning from the Google Adsense team about it. But I was completely clueless how to solve this weired issue in Joomla. Luckily I found a solution that there are these Responsive ADs which addresses this problem. Finally after I did changes things started looking better. Apart from this there are also issues in case if you are looking for any extensive customization in terms of managing your article categories, etc. Not that they are impossible in Joomla, but they are tricky to do so and you need to repeat these steps all over again for each article/category.

Joomla is troublesome when you are building your own CDN too. Since you cannot extensively control the dynamic links/resources/etc. However if you purchase third-party CDN services, by installing Joomla extensions/plug-ins you can deploy over a CDN. But it is still tricky and challenging. In my case it is out of question. So this is also one of the reasons I took a decision to move away from Joomla and build my own PHP-based website from scratch.

Screenshot of old The TOFFEE Project website built with Joomla:
Screenshot of old The TOFFEE Project website built with Joomla

and as you know here is the screenshot of the The TOFFEE Project website built from scratch with PHP:
Screenshot of old The TOFFEE Project website built from scratch with PHP

While this transition I have also changed the Logo and the theme from Brown to vibrant Orange. With this change the website looks spacious, dynamic, vibrant, and the orange theme allows the website links stand out unlike the old brown theme links. Since it is entirely custom written website it is easy in future to write further automated scripts to spread the website (contents/resources) on a custom built CDN infrastructure. We can load-share, redirect/point images/resources to different dedicated CDN node(s), if the main website is facing glitches, we can redirect to different CDN node(s). We can host multiple CDN nodes on multiple web-hosting provider servers. We can even modify the DNS-entry to point to a different hosting server whenever it is needed or if the main site (hosting server) is down.

Here is my live video log of the same:



Suggested Topics:


Generic CDN


Building my own CDN

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

Demo TOFFEE-DataCenter WAN Optimization packaging feature ↗
Saturday' 13-Mar-2021

TOFFEE DataCenter WAN Optimization - Google Hangouts demo and VOIP Optimization ↗
Saturday' 13-Mar-2021
TOFFEE DataCenter WAN Optimization - Google Hangouts demo and VOIP Optimization

TOFFEE-DataCenter Download :: TOFFEE-DATACENTER-1.2.2-1-portable ↗
Saturday' 13-Mar-2021

TOFFEE (and TOFFEE-DataCenter) deployment with web-proxy cache ↗
Saturday' 13-Mar-2021
If you want to deploy TOFFEE along with a web-proxy cache (such as Squid Proxy) you can deploy the same as shown below. TOFFEE does not cache files. TOFFEE does packet level network optimization. So if you want caching your web content you can use transparent mode web-proxy cache intercepting your WAN links. A web-proxy may reduce amount of data being processed (optimized) within these TOFFEE devices and so reduce the CPU overheads and improve its performance.

Network MTU research and optimization of WAN Links ↗
Saturday' 13-Mar-2021
Network MTU research and optimization of WAN Links

Why TOFFEE is forked from TrafficSqueezer ↗
Saturday' 13-Mar-2021
TrafficSqueezer is an open-source WAN Optimization project. TrafficSqueezer is mainly a research project which is started around mid-2006. It is initially started as a research (or prototype) code even before it is officially registered in Sourceforge.net. But this code is just primitive user-space raw socket modules. This is later refined and a pre-alpha version is created. Followed by which Alpha release. This prototype code is moved from user-space to Linux Kernel (Kernel Space) and then the journey begin in terms of making a serious WAN Optimization solution. Once the pre-beta and beta releases are complete the mainstream series is started.



TCP Tune-up and Performance Analysis Graphs - Congestion Control - Research - Dos and Don'ts ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha WAN Emulation software development - Update: 20-Oct-2016 ↗
Saturday' 13-Mar-2021
I was doing some specific tests in my TOFFEE and TOFFEE-DataCenter (WAN optimization) scenarios such as variable upload and download speeds. And I was also doing some experiments with speedtest.net and I did some of these tests with TOFFEE-Mocha. I realized there is a case that I can introduce asymmetric constant delays so that you can get different download speed and a different upload speed. And in some cases much faster download speeds and relatively slower upload speeds.

TOFFEE-Mocha WAN Emulator Jitter Feature ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha WAN emulator Lab deployment and topology guide ↗
Saturday' 13-Mar-2021



Featured Educational Video:
Watch on Youtube - [943//1] x23e TrueNAS ZFS Pool Resilver over and over again issue | ZFS NAS Storage | Forever Resilver ↗

VPN Network Optimization via TOFFEE WAN Optimization ↗
Saturday' 13-Mar-2021
VPN Networks may degrade network performance due to various packet processing overheads such as encryption and by adding extra network protocol header(s) (such as IPv4/IPv6, IPSec, etc). This may inflate near MTU sized packets and causes excessive packet fragmentation. Here are the few examples of packet processing involved in a VPN (or a VPN like) Tunnel. With TOFFEE you can optimize these packets even before they get processed on to a VPN device. TOFFEE optimizes packet contents (application payload and transport headers) so that these TOFFEE optimized packets when they get processed by VPN devices (or VPN software stack) they may never need further packet fragmentation. Here is a deployment scenario of TOFFEE with VPN devices.

TOFFEE-DataCenter as a VNF for NFV ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha WAN Emulation software development - Update: 18-June-2016 ↗
Saturday' 13-Mar-2021
In the previous update (17-Jun-2016) I discussed about the upcoming new Random Packet drop feature along with other completed features. Now I completed the entire TOFFEE-Mocha Random packet drop feature. I completed all the kernel components and the UI support of the same. And to make GUI settings more organized I split the earlier Basic-Settings page into two separate pages namely: Packet Drop and Packet Delay. So this way it is simple to understand settings according to their functionality.

Network Latency and Bandwidth Assessment - for Network Admins and Infrastructure Architects ↗
Saturday' 13-Mar-2021



Watch on Youtube - [466//1] 158 VLOG - TOFFEE WAN Optimization Software Development live update - 6-Nov-2016 ↗

CDN Content Delivery Networks - Types ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server