AI everywhere? Where are we going?
We all know that we have entered intro the new era of AI, no matter what field we are into but we are thinking, talking and working towards AI. I spoke to many founders and co founders in past few weeks and they all are working towards something related to AI. The wave is real, its effective and its more than chatbots. The number of applications, the number of research papers are rising in this field creating really cool possibilities so YES we should be having a basic knowledge of what is happening around is, what is happening within the products that we are using.
I have been learning a lot of Generative AI, it’s angle with cloud native and how Kubernetes is making things easier. The Kubernetes community and cloud native with other foundations are working together to solve complex infra challenges. Kubernetes has kind of become defacto standard for running the inferencing or doing training via batch jobs that runs for several days.
Did you know that OpenAI is the org that published a blog of scaling Kubernetes nodes to 7500. Huggingface, boomberg, CERN, Adobe they all run on Kubernetes which shows how significant it is in the AI ecosystem.
Kubernetes KEP’s like Dynamic resource allocation and Improved multi-numa alignment in Topology Manager shows how much invested Kubernetes community is in order to use GPU’s more efficiently.
All this shows the progress towards helping innovators innovate. This AI revolution is even going to be bigger but that does not mean its sidetracking other stuffs as there are innovations happening at all levels → Wasm with wasi 0.2 out, platform engineering more and more tools, more enhancements in Kubernetes ecosystem. AI is big and impactful and will keep rising in terms of how we use but there will also be significant improvements and developments in other areas including OS and OSS projects.
What have I been upto?
I have been preparing my talk for Civo Navigate happening next week in Austin. Yes its about Generative AI in Kubernetes era with Kubeflow and I will show an end to end demo of stable diffusion model running on Kubeflow. It was fun building the demo and learning along the way. With this I want to cover the basics of generative AI and Kubeflow with its cloud native angle.
I have a few sessions selected for KubeCon and WASM/IO so I will be there for both those conferences as well.
WASM IO sessions
Create Production-Grade Wasm Applications on Kubernetes [Workshop]
Sustainability with WASM? - faster, greener computing [Panel]
KubeCon Sessions
Sneakpeak of my demo…if you do not understand it’s fine as I will live demo explaining this.
What are your thoughts on GenAI in general and where it is going? Do comment.
Awesome Videos
Sponsored Content
Without the sponsors I won’t be able to give you an authentic newsletter with all the cool stuff, so please do check them out
Cast AI - How Gaming Companies Reduce Their Cloud Costs Using Automation
Komodor - Configuration as Code: Everything Developers Need to Know
Awesome Reads
Monitoring TLS Endpoint Certificate Expiration with Prometheus - If you have HTTPS endpoints in your infrastructure, you will want to make sure that none of their TLS certificates are about to expire without you noticing. This blog walks you though on how you can use Prometheus' Blackbox Exporter to monitor for TLS certificates that are about to expire soon, so you can renew them in time.
No GPU? No problem. localllm lets you develop gen AI apps on local CPUs - Google Cloud introduces localllm, a tool that enables developers to use large language models (LLMs) locally on CPUs within Cloud Workstations, eliminating the need for GPUs and facilitating AI app development on local devices. This solution leverages quantized models, allowing for efficient, cost-effective development with improved performance and data security, fully integrated within the Google Cloud ecosystem.
Networking in Kubernetes -Simplified - The article simplifies Kubernetes networking for beginners, covering essential concepts such as network namespaces, pod networking, DNS with CoreDNS, container networking interfaces, and the role of Ingress in managing external access to applications. It highlights the differences between Docker and Kubernetes networking, emphasizing Kubernetes' comprehensive approach to cluster-level communication, service discovery, and security.
Cloud Native Disaster Recovery for Stateful Workloads - This document introduces Cloud Native Disaster Recovery, emphasizing a new perspective on disaster recovery strategies for stateful applications in cloud-native environments. It outlines the essential concepts of availability and consistency, explores the challenges of distributed stateful workloads, reviews consensus protocols for workload coordination, and concludes with disaster recovery strategies for container-native stateful workloads, providing a comprehensive framework for understanding and implementing effective disaster recovery solutions in modern cloud settings.
Strimzi joins the CNCF Incubator - Strimzi is focused on deploying and running Apache Kafka clusters on Kubernetes. Apache Kafka is a leading platform for building event-based microservices architectures and real-time data pipelines, and it is horizontally scalable and fault-tolerant by design. Running Apache Kafka on Kubernetes can be complicated, but Strimzi reduces the complexity by using the operator pattern. This includes the initial installation as well as the day-2 operations for upgrades and security.
Kubesimplify Updates
Wasm course is going good and will be reaching 4k soon, keep learning WebAssmebly and share in your network
We have written two new shiny blogs in past 2 weeks as well by Krish Gupta
Automated GitHub Releases with GitHub Actions and Conventional Commits
Reducing Image Size using Multi-stage builds for a Go application
Resources and Repos
GPTscript - Natural Language Programming
RubraAI - Develop your AI assistants locally.
Explainix - Explain Nix syntax visually. Snippet below showcases most of the language features Nix has to offer.
Kermoo - 🪱 Kermoo offers resilience testing with Process Delays, Back-end Failures, CPU Simulations, and Memory Leaks. Boost your system reliability effortlessly.
Learn from X platform
https://x.com/natfriedman/status/1754519304471814555?s=20
https://x.com/samcraigjohnson/status/1755428409059250385?s=20
https://x.com/Aurimas_Gr/status/1755577998072328638?s=20
Do subscribe to my free newsletter to stay updated in cloud native and WebAssembly. Thats the least you can do ;)