Using a proxy to optimize downloads and packet updates
Daniel Nashed – 20 April 2025 23:32:52
Proxying downloads can be tricky. If the resouce is HTTPS there isn't easy way because the connection is encrypted.
But for HTTP resources a Squid proxy can cache downloads very effective.
Cache HTTP resource
Linux distributions often use HTTP resources, because the software itself is signed.
This opens the door for effective caching.
I have pointed Linux machine and Docker host to my Squid proxy.
Not only that the cache dramatically reduce the downloaded data on second download.
It also reduces the download time dramatically.
Some hot data might even come from memory as you see in my test below.
Caching should be setup with care. Not everything should be cached for a longer time.
*.deb packages can be safely cached, because the file names would have a different file name when updated.
1745101322.369 485 172.17.0.2 TCP_OFFLINE_HIT/200 42288974 GET http://archive.ubuntu.com/ubuntu/pool/universe/o/openjdk-lts/openjdk-11-jre-headless_11.0.26%2b4-1ubuntu1%7e24.04_amd64.deb - HIER_NONE/- application/vnd.debian.binary-package
1745101322.370 0 172.17.0.2 TCP_MEM_HIT/200 209690 GET http://archive.ubuntu.com/ubuntu/pool/universe/o/openjdk-lts/openjdk-11-jre_11.0.26%2b4-1ubuntu1%7e24.04_amd64.deb - HIER_NONE/- application/vnd.debian.binary-package
Cache container images
Container registries mostly use HTTPS. In that case a registry with caching support like the Harbor registry could make sense.
Cache MyHCLSoftware downloads
HCL Software downloads like many other software downloads are HTTPS only.
One of the main reason is that authentication is required.
The Domino Download Server project provides a way to download software, which then can be locally accessed.
A Domino Download Server could be the source for internal downloads, container builds and even the Domino AutoUpdate functionality can leverage the Download Server.
https://github.com/nashcom/domino-startscript/tree/develop/domdownload-server
Conclusion
Now matter how fast your internet connection is, a local download is always faster and reduces resource usage.
- Comments [0]
![[HCL Domino]](../lotus-domino.gif){kind=small}
![[Domino on Linux]](../domino-linux.gif){kind=small}
![[Nash!Com]](../nashcom.gif){kind=small}
![[Daniel Nashed]](../daniel-nsh.gif){kind=small}