Wow, KubeCon + CloudNativeCon Europe 2025 in London was a improbable time! Our Azure Storage crew was thrilled to change insights and success tales at this vibrant group occasion. If you happen to missed it, don’t fear! We’re right here to share what we confirmed off on the con: how we’re enhancing efficiency, cost-efficiency, and AI
Wow, KubeCon + CloudNativeCon Europe 2025 in London was a improbable time! Our Azure Storage crew was thrilled to change insights and success tales at this vibrant group occasion. If you happen to missed it, don’t fear! We’re right here to share what we confirmed off on the con: how we’re enhancing efficiency, cost-efficiency, and AI capabilities for your workloads on Azure.
Optimize your open-source databases with Azure Disks
Open-source databases similar to PostgreSQL, MariaDB, and MySQL are among the many mostly deployed stateful workloads on Kubernetes. For situations that demand extraordinarily low latency and excessive enter/output operations per second (IOPS)—similar to working these databases for transactional workloads—Azure Container Storage lets you faucet into native ephemeral non-volative reminiscence categorical (NVMe) drives inside your node pool. This supplies sub-millisecond latency and as much as half one million IOPS, making it a powerful match for performance-critical use instances. In our upcoming v1.3.0 replace, we have now made vital optimizations particularly for databases.
In comparison with the earlier v1.2.0 model, you may count on as much as a 5 occasions enhance in transactions per second (TPS) for PostgreSQL and MySQL deployments. If you happen to’re searching for the perfect steadiness of sturdiness, efficiency, and price for storage, Premium SSD v2 disks stays our advisable default for database workloads. Premium SSD v2 affords a versatile pricing mannequin that expenses per gigabyte and consists of beneficiant baseline IOPS and throughput without cost out of the field. You possibly can dynamically scale IOPS and throughput as wanted, permitting you to fine-tune efficiency whereas optimizing for price-efficiency.
At KubeCon, we demonstrated how builders might readily reap the benefits of native NVMe and Premium SSD v2 Disks to construct their extremely obtainable and performant PostgreSQL deployments. If you wish to observe alongside your self, try the newly republished PostgreSQL on AKS documentation under!
Speed up your AI workflows with Azure Blob Storage
Constructing an AI workflow calls for scalable storage to host large quantities of knowledge—whether or not it’s uncooked sensor logs, high-resolution pictures, or multi-terabyte mannequin checkpoints. Azure Blob Storage and BlobFuse2 with the Container Storage Interface (CSI) driver present a seamless solution to retailer and retrieve this information at scale. With BlobFuse2, you entry blob storage simply as a persistent quantity, treating it like an area file system. With the newest model of Blobfuse2 – 2.4.1, you may:
- Pace up mannequin coaching and inference: BlobFuse2’s enhanced streaming assist reduces latency for preliminary and repeated reads. Utilizing BlobFuse2 to load massive datasets or fine-tuned mannequin weights immediately from blob storage into native NVMe drives on GPU SKUs successfully optimizes the effectivity of your AI workflow.
- Simplify information preprocessing: AI workflows typically require frequent transformations—similar to normalizing pictures or tokenizing textual content. Through the use of BlobFuse2’s file-based entry, information scientists can preprocess and retailer outcomes immediately in blob storage, preserving pipelines environment friendly.
- Guarantee information integrity at scale: When dealing with petabytes of streaming information, integrity checks matter. BlobFuse2 now consists of improved CRC64 validation for information saved on native disk, guaranteeing dependable reads and writes, even when working with distributed AI clusters.
- Parallel entry of large datasets: Carried out parallel downloads and uploads to considerably lower the time required for accessing massive datasets saved in blobs. This enhancement permits for sooner information processing and elevated effectivity, guaranteeing optimum utilization of GPU sources and enhancing coaching effectivity.
Scale your stateful workloads with Azure Recordsdata
Steady Integration and Steady Supply/Deployment (CI/CD) pipelines, one of many well-liked stateful workloads, want shared persistent volumes to host artifacts within the repository, the place Azure Premium Recordsdata is the storage of selection on Azure. These artifacts are saved in small information that incur heavy metadata operations on a file share. To hurry up CI/CD workflows, the Azure Recordsdata crew just lately introduced the overall availability of metadata caching for premium SMB file shares. This new functionality reduces metadata latency by as much as 50 %, benefiting metadata-intensive workloads that sometimes host many small information in a single share. At KubeCon, we showcased how metadata caching can speed up repetitive construct processes on GitHub, seek advice from the repo and check out it out your self.
For much less performance-demanding stateful workloads, Normal Recordsdata with the brand new Provisioned v2 billing mannequin affords higher value predictability and management as shared persistent volumes. The Provisioned v2 mannequin shifts from usage-based to provisioned billing, permitting you to specify required storage, IOPS, and throughput with higher scale. Now you can broaden your file share from 32 GiB to 256 TiB, 50,000 IOPS, and 5 GiB/sec throughput as your functions demand.
KubeCon + CloudNativeCon was an exquisite alternative to immediately work together with builders and study from our clients. As all the time, due to our clients and companions for contributing to the occasion’s worth and significance, and we sit up for seeing you once more in November for KubeCon North America!
