Tech Summary: Development Platform, LLMs, and, Cilium
I spent my last few weeks between different areas of tech, and here's the summary.
Blogging in past helped me understand how did I spend my days. It allows me to understand my where I stand. As a software-driven person, I tend to upload a lot of small notes and projects on GitHub and GitLab, mostly privately as it is mainly a personal reference. This gets me to stick to blogging even at slow pace.
Before I get into the techy stuff, I would like to appreciate the greet I received from Abdullah in his recent blog post.
In the name of Allah I begin.
Nawah: Development Platform
Internal Developer Platform is a platform companies and organisations build to be used internally by the development and infrastructure teams, and serves as a single platform to plan and execute their work. I'll spare another blog post for the history, and I'll use this spot to speak of Nawah, a framework I engineered and used for the projects I work on. The link between IDP and Nawah is I began a while ago re-writing Nawah as a IDP, as to benefit from the concepts while maintaining its open-source nature.
The work I've done on this transition is very satisfying. The step I'm at currently is building a technical preview that allows me to get some feedback from some of my connections who I can depend on to get the feedback I need.
Large Language Models
AI is the talk; Over one night, the tech became accessible to all and disrupted the industry. The technical reason for this is the availability of high-end performance GPUs that contributed to making it possible to do the hard math for ML and AI.
The most adequate LLM at this point is
gpt-3.5 from OpenAI, as it has the best Arabic language support, unlike majority of other models. Then, there's open-source model Vicuna, which is almost there but not yet. So, I'll be stuck with OpenAI models for sometime.
As to contribute to the future of Arabic AI, I'm working with Abdullah - not Abdullah from the home portrait or the one from small pages blog, but a third - who is a data engineer, as we are working on building an Arabic LLM training dataset which is the least we can contribute.
Cilium is a system that can be installed on Kubernetes clusters to provide certain functionalities around the concept of service mesh. It benefits from Linux kernel eBPF features to get a single pod to provide the service mesh functionality for every node, rather than having a side-car for every pod. Such a change involves better security and networking overall.
I recently started using it on AWS, after failing to use it on Linode, which I'm trying to overcome.
I hope to be able to write more tech blog posts as one of the reasons of blog is to enrich Arabic content in the fields of my expertise, although I'll keep it personal blog.
Header photo: A work by Kelly Sikkema on Unsplash