32 subscribers
با برنامه Player FM !
Mastering DevOps with Apache Kafka, Kubernetes, and Confluent Cloud ft. Rick Spurgeon and Allison Walther
Manage episode 424666833 series 2510642
How do you use Apache Kafka®, Confluent Platform, and Confluent Cloud for DevOps? Integration Architects Rick Spurgeon and Allison Walther share how, including a custom tool they’ve developed for this very purpose.
First, Rick and Allison share their perspective of what it means to be a DevOps engineer. Mixing development and operations skills to deploy, manage, monitor, audit, and maintain distributed systems. DevOps is multifaceted and can be compared to glue, in which you’re stitching software, services, databases, Kafka, and more, together to integrate end to end solutions.
Using the Confluent Cloud Metrics API (actionable operational metrics), you pull a wide range of metrics about your cluster, a topic or partition, bytes, records, and requests. The Metrics API is unique in that it is queryable. You can send this API question, “What's the max retained bytes per hour over 10 hours for my topic or my cluster?” and find out just like that.
To make writing operators much easier, Rick and Allison also share about Crossplane, KUDO, Shell-operator, and how to use these tools.
EPISODE LINKS
- Confluent Cloud Metrics API
- Shell Operator
- DevOps for Apache Kafka
- The Kubernetes Universal Declarative Operator
- Introducing the AWS Controllers for Kubernetes (ACK)
- Manage any infrastructure your applications need directly from Kubernetes with Crossplane
- DevOps for Apache Kafka with Kubernetes and GitOps
- Spring Your Microservices into Production with Kubernetes and GitOps
- Join the Confluent Community Slack
- Learn more with Kafka tutorials, resources, and guides at Confluent Developer
- Live demo: Kafka streaming in 10 minutes on Confluent Cloud
- Use 60PDCAST to get an additional $60 of free Confluent Cloud usage (details)
265 قسمت
Manage episode 424666833 series 2510642
How do you use Apache Kafka®, Confluent Platform, and Confluent Cloud for DevOps? Integration Architects Rick Spurgeon and Allison Walther share how, including a custom tool they’ve developed for this very purpose.
First, Rick and Allison share their perspective of what it means to be a DevOps engineer. Mixing development and operations skills to deploy, manage, monitor, audit, and maintain distributed systems. DevOps is multifaceted and can be compared to glue, in which you’re stitching software, services, databases, Kafka, and more, together to integrate end to end solutions.
Using the Confluent Cloud Metrics API (actionable operational metrics), you pull a wide range of metrics about your cluster, a topic or partition, bytes, records, and requests. The Metrics API is unique in that it is queryable. You can send this API question, “What's the max retained bytes per hour over 10 hours for my topic or my cluster?” and find out just like that.
To make writing operators much easier, Rick and Allison also share about Crossplane, KUDO, Shell-operator, and how to use these tools.
EPISODE LINKS
- Confluent Cloud Metrics API
- Shell Operator
- DevOps for Apache Kafka
- The Kubernetes Universal Declarative Operator
- Introducing the AWS Controllers for Kubernetes (ACK)
- Manage any infrastructure your applications need directly from Kubernetes with Crossplane
- DevOps for Apache Kafka with Kubernetes and GitOps
- Spring Your Microservices into Production with Kubernetes and GitOps
- Join the Confluent Community Slack
- Learn more with Kafka tutorials, resources, and guides at Confluent Developer
- Live demo: Kafka streaming in 10 minutes on Confluent Cloud
- Use 60PDCAST to get an additional $60 of free Confluent Cloud usage (details)
265 قسمت
Tutti gli episodi
×
1 Migrate Your Kafka Cluster with Minimal Downtime 1:01:30

1 Top 6 Worst Apache Kafka JIRA Bugs 1:10:58

1 Optimizing Apache JVMs for Apache Kafka 1:11:42

1 International Podcast Day - Apache Kafka Edition | Streaming Audio Special 1:02:22

1 Capacity Planning Your Apache Kafka Cluster 1:01:54

1 Streaming Analytics and Real-Time Signal Processing with Apache Kafka 1:06:33

1 Common Apache Kafka Mistakes to Avoid 1:09:43

1 Scaling an Apache Kafka Based Architecture at Therapie Clinic 1:10:56
به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.