Alejandro Saucedo - Industrial Machine Learning Pipelines with Python & Airflow

author Alejandro Saucedo   5 мес. назад

2 Like   0 Dislike

Google's Deep Mind Explained! - Self Learning A.I.

Subscribe here: Become a Patreon!: Visual animal AI: Hi, welcome to ColdFusion (formally known as ColdfusTion). Experience the cutting edge of the world around us in a fun relaxed atmosphere. Sources: Why AlphaGo is NOT an "Expert System": “Inside DeepMind” Nature video: “AlphaGo and the future of Artificial Intelligence” BBC Newsnight: //Soundtrack// Disclosure - You & Me (Ft. Eliza Doolittle) (Bicep Remix) Stumbleine - Glacier Sundra - Drifting in the Sea of Dreams (Chapter 2) Dakent - Noon (Mindthings Rework) Hnrk - fjarlæg Dr Meaker - Don't Think It's Love (Real Connoisseur Remix) Sweetheart of Kairi - Last Summer Song (ft. CoMa) Hiatus - Nimbus KOAN Sound & Asa - This Time Around (feat. Koo) Burn Water - Hide » Google + | » Facebook | » My music | or » » » Collection of music used in videos: Producer: Dagogo Altraide Editing website: Coldfusion Android Launcher: » Twitter | @ColdFusion_TV

How to: Work at Google — Example Coding/Engineering Interview

Watch our video to see two Google engineers demonstrate a mock interview question. After they code, our engineers highlight best practices for interviewing at Google. Learn more about how we hire at, then head over to to find your role. Also check out our companion video, How to Work at Google: Prepare for an Engineering Interview ( Subscribe to Life at Google for more videos → Follow us! Twitter: Facebook: Google Plus: #LifeAtGoogle

All Things Water Course I, Activated Sludge

Advance your industry knowledge and expertise with All Things Water video courses featuring water treatment processes, water sector innovations, environmental challenges and public policies impacting the water industry. The first video in this series covers the activated sludge process, the main secondary biological process used in virtually all wastewater treatment plants worldwide.

After watching this, your brain will not be the same | Lara Boyd | TEDxVancouver

In a classic research-based TEDx Talk, Dr. Lara Boyd describes how neuroplasticity gives you the power to shape the brain you want. Recorded at TEDxVancouver at Rogers Arena on November 14, 2015. YouTube Tags: brain science, brain, stroke, neuroplasticity, science, motor learning, identity, TED, TEDxVancouver, TEDxVancouver 2015, Vancouver, TEDx, Rogers Arena, Vancouver speakers, Vancouver conference, ideas worth spreading, great idea, Our knowledge of the brain is evolving at a breathtaking pace, and Dr. Lara Boyd is positioned at the cutting edge of these discoveries. In 2006, she was recruited by the University of British Columbia to become the Canada Research Chair in Neurobiology and Motor Learning. Since that time she has established the Brain Behaviour Lab, recruited and trained over 40 graduate students, published more than 80 papers and been awarded over $5 million in funding. Dr. Boyd’s efforts are leading to the development of novel, and more effective, therapeutics for individuals with brain damage, but they are also shedding light on broader applications. By learning new concepts, taking advantage of opportunities, and participating in new activities, you are physically changing who you are, and opening up a world of endless possibility. This talk was given at a TEDx event using the TED conference format but independently organized by a local community. Learn more at

Coal, Steam, and The Industrial Revolution: Crash Course World History #32

Mongols Shirts and Crash Course Posters! In which John Green wraps up revolutions month with what is arguably the most revolutionary of modern revolutions, the Industrial Revolution. While very few leaders were beheaded in the course of this one, it changed the lives of more people more dramatically than any of the political revolutions we've discussed. So, why did the Industrial Revolution happen around 1750 in the United Kingdom? Coal. Easily accessible coal, it turns out. All this, plus you'll finally learn the difference between James Watt and Thomas Newcomen, and will never again be caught telling people that your blender has a 900 Newcomen motor. Crash Course World History is now available on DVD! Follow us! @thecrashcourse @realjohngreen @raoulmeyer @crashcoursestan @saysdanica @thoughtbubbler Like us! ‪ Follow us again! ‪ Support Crash Course on Patreon:

Industrial Machine Learning Pipelines with Python & Airflow
[EuroPython 2018 - Talk - 2018-07-26 - Fintry [PyData]]
[Edinburgh, UK]

By Alejandro Saucedo

Industrial Machine Learning

This talk will provide key insights on the learnings I have obtained throughout my career building & deploying machine learning systems in critical environments across several sectors. I will provide a deep dive on how to build scalable and distributed machine learning data pipelines using Airflow with a Celery backend. I will also compare Airflow with other technologies available out there and how it differentiates, such as Luigi, Chronos, Pinball, etc. If you attend the talk, you will obtain an understanding on the solid fundamentals of Airflow, together with its caveats and walk-arounds for more complex use-cases. As we proceed with the examples, I will cover the challenges that you will run into when scaling Machine Learning systems, and how Airflow can be used to address these using a manager-worker-queue architecture for distributed processing with Celery. By the end of this talk you will have the knowledge required to build your own industry-ready machine learning pipelines to process data at scale, and I will provide further reading resources so people are able to implement the knowledge obtained almost right away.

Comments for video: