{"id":55250,"date":"2020-01-16T00:00:00","date_gmt":"2020-01-15T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/avito-kafka-meetup-konnektory-integratsiya-oblaka"},"modified":"2020-02-18T14:03:21","modified_gmt":"2020-02-18T11:03:21","slug":"avito-kafka-meetup-konnektory-integratsiya-oblaka","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/avito-kafka-meetup-konnektory-integratsiya-oblaka","title":{"rendered":"Avito Kafka meetup: connectors, integration, clouds","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Hello! On Thursday, January 23, we will have our first meetup about Apache Kafka. We will discuss integration, source connectors, and launching scalable applications in Kubernetes. Presentations will be made by engineers from Booking.com, Confluent, and Avito. <\/p>\n

<\/p>\n

We meet at 6:00 PM. Register yourself and invite colleagues. Below \u2014 announcements of the talks, a registration link, and a video stream of the meetup.<\/p>\n

<\/p>\n

\"Avito<\/p>\n

<\/a><\/noindex><\/p>\n

Reports<\/h1>\n

<\/p>\n

Connectors: why are there so many of you? \u2014 Anatoly Soldatov, Avito<\/h3>\n

<\/p>\n

\"Avito <\/p>\n

<\/p>\n

Recently, Martin Kleppmann commented on Twitter about Netflix's article on their new CDC connector: \"Netflix created their own Change Data Capture (CDC) connector for MySQL and PostgreSQL\u2026 although perhaps it would have been better to contribute to Debezium?\" In my presentation, I will give a brief overview of source connectors. We will then look at the advantages and disadvantages of well-known connectors for PostgreSQL, including Debezium. Finally, I will try to answer Martin's tweet and explain why we decided to create our own CDC connector at Avito and what resulted from it.<\/p><\/blockquote>\n


\n <\/p>\n

<\/p>\n

How to tame Apache Kafka? The experience of Booking.com \u2014 Alexander Mironov, Booking.com<\/h3>\n

<\/p>\n

\"Avito <\/p>\n

<\/p>\n

Despite all the capabilities of Apache Kafka, it is not easy to integrate and maintain. In the presentation, I will explain how we solve this challenge at Booking.com, where Kafka and the service built around it are used as the main product for streaming data. We will take a detailed look at how a relatively small team maintains control over dozens of clusters and ensures data security, while also sharing laughs \u2014 or tears \u2014 over the bugs and issues we have had to tackle.<\/p><\/blockquote>\n


\n <\/p>\n

<\/p>\n

Kafka on Kubernetes: is it Juan's sombrero? \u2014 Victor Gamov, Confluent<\/h3>\n

<\/p>\n

\"Avito <\/p>\n

<\/p>\n

If you need to choose the most efficient distributed platform for processing real-time streaming data, the answer today is obvious \u2014 it's Apache Kafka! If you need to deploy a scalable application in the cloud with high resilience, redundancy, load distribution, and containers, you need Kubernetes.<\/p>\n

And if you cross this snake and hedgehog, you get a scalable application processing real-time streams in the cloud. Great, isn't it? But is it all that simple? Are there enough Lego bricks that basic Kubernetes provides to launch serious distributed systems that require state storage? <\/p>\n

I am Viktor Gamov, a Developer Advocate from Confluent, and I'll help you navigate through this complexity. I'll also attempt to answer the question, 'Is it worth running Apache Kafka and its components, as well as stream processing applications on Kubernetes?'
\n
\n <\/p><\/blockquote>\n

<\/p>\n

Passwords and credentials<\/h1>\n

<\/p>\n

The meetup will start on January 23 at 18:00. Participation is free, but you need to register<\/a><\/noindex>. Please provide your real first and last name in the registration form. Don't forget to bring your passport or driver's license to get a pass at the reception on the day of the event.<\/p>\n

<\/p>\n

Address: Avito Office, Lesnaya 7<\/a><\/noindex>.<\/p>\n

<\/p>\n

If you cannot attend the meeting, you can watch the live stream on the AvitoTech YouTube channel<\/a><\/noindex>. You will be able to ask questions during the live broadcast, which we will convey to the speakers.<\/p>\n

<\/p>\n

See you there!<\/p>\n

Source: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u0438\u0432\u0435\u0442! \u0412\u00a0\u0447\u0435\u0442\u0432\u0435\u0440\u0433, 23 \u044f\u043d\u0432\u0430\u0440\u044f, \u043f\u0440\u043e\u0439\u0434\u0451\u0442 \u043d\u0430\u0448 \u043f\u0435\u0440\u0432\u044b\u0439 \u043c\u0438\u0442\u0430\u043f \u043f\u0440\u043e\u00a0Apache Kafka. \u0411\u0443\u0434\u0435\u043c \u0433\u043e\u0432\u043e\u0440\u0438\u0442\u044c \u043e\u0431 \u0438\u043d\u0442\u0435\u0433\u0440\u0430\u0446\u0438\u0438, source \u043a\u043e\u043d\u043d\u0435\u043a\u0442\u043e\u0440\u0430\u0445 \u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0435 \u043c\u0430\u0441\u0448\u0442\u0430\u0431\u0438\u0440\u0443\u0435\u043c\u044b\u0445 \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439 \u0432\u00a0Kubernetes. \u0421 \u0434\u043e\u043a\u043b\u0430\u0434\u0430\u043c\u0438 \u0432\u044b\u0441\u0442\u0443\u043f\u044f\u0442 \u0438\u043d\u0436\u0435\u043d\u0435\u0440\u044b Booking.com, Confluent \u0438 \u0410\u0432\u0438\u0442\u043e. \u0412\u0441\u0442\u0440\u0435\u0447\u0430\u0435\u043c\u0441\u044f \u0432\u00a018:00. \u0420\u0435\u0433\u0438\u0441\u0442\u0440\u0438\u0440\u0443\u0439\u0442\u0435\u0441\u044c \u0441\u0430\u043c\u0438 \u0438 \u043f\u0440\u0438\u0433\u043b\u0430\u0448\u0430\u0439\u0442\u0435 \u043a\u043e\u043b\u043b\u0435\u0433. \u041f\u043e\u0434 \u043a\u0430\u0442\u043e\u043c \u2014 \u0430\u043d\u043e\u043d\u0441\u044b \u0432\u044b\u0441\u0442\u0443\u043f\u043b\u0435\u043d\u0438\u0439, \u0441\u0441\u044b\u043b\u043a\u0430 \u043d\u0430 \u0440\u0435\u0433\u0438\u0441\u0442\u0440\u0430\u0446\u0438\u044e \u0438 \u0432\u0438\u0434\u0435\u043e\u0442\u0440\u0430\u043d\u0441\u043b\u044f\u0446\u0438\u044e \u043c\u0438\u0442\u0430\u043f\u0430. \u0414\u043e\u043a\u043b\u0430\u0434\u044b \u041a\u043e\u043d\u043d\u0435\u043a\u0442\u043e\u0440\u044b: \u0437\u0430\u0447\u0435\u043c \u0432\u0430\u0441 \u0442\u0430\u043a \u043c\u043d\u043e\u0433\u043e \u2014 \u0410\u043d\u0430\u0442\u043e\u043b\u0438\u0439 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55250","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Avito Kafka meetup: connectors, integration, clouds | ProHoster","description":"Hello! On Thursday, January 23, our first meetup on Apache Kafka will take place. We will discuss integration, source connectors, and launching scalable applications on Kubernetes.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/avito-kafka-meetup-konnektory-integratsiya-oblaka","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Avito Kafka meetup: \u043a\u043e\u043d\u043d\u0435\u043a\u0442\u043e\u0440\u044b, \u0438\u043d\u0442\u0435\u0433\u0440\u0430\u0446\u0438\u044f, \u043e\u0431\u043b\u0430\u043a\u0430 | ProHoster","og:description":"\u041f\u0440\u0438\u0432\u0435\u0442! \u0412 \u0447\u0435\u0442\u0432\u0435\u0440\u0433, 23 \u044f\u043d\u0432\u0430\u0440\u044f, \u043f\u0440\u043e\u0439\u0434\u0451\u0442 \u043d\u0430\u0448 \u043f\u0435\u0440\u0432\u044b\u0439 \u043c\u0438\u0442\u0430\u043f \u043f\u0440\u043e Apache Kafka. \u0411\u0443\u0434\u0435\u043c \u0433\u043e\u0432\u043e\u0440\u0438\u0442\u044c \u043e\u0431 \u0438\u043d\u0442\u0435\u0433\u0440\u0430\u0446\u0438\u0438, source \u043a\u043e\u043d\u043d\u0435\u043a\u0442\u043e\u0440\u0430\u0445 \u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0435 \u043c\u0430\u0441\u0448\u0442\u0430\u0431\u0438\u0440\u0443\u0435\u043c\u044b\u0445 \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439 \u0432 Kubernetes.","og:url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/avito-kafka-meetup-konnektory-integratsiya-oblaka","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-15T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:21+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55250","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 19:47:38","updated":"2022-10-05 03:46:25","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/55250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=55250"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/55250\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=55250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=55250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=55250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}