What we’re about
PyData Bristol is the Bristol chapter of the international PyData community.
Material
All the material from previous meetups can be found in this GitHub repository. The material for the workshops can be found in this other GitHub repository.
Call for proposal
If you would like to give a talk (from 5 minutes to 1 hour) please fill this google form with some initial details and we will contact you as soon as possible. The talk could be to present your current work, a topic that you just learned, the reason why you are attending PyData Bristol. As an example, these is a small list with the most mentioned topics from PyData Bristol community: machine learning, data visualisation, python, data science, artificial intelligence, natural language processing, deep learning, neural networks, business, to mention a few. Thanks in advance for your time! :)
What is PyData?
PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R.
PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. The PyData Code of Conduct (http://pydata.org/code-of-conduct.html) governs this meetup. To discuss any issues or concerns relating to the code of conduct or the behavior of anyone at a PyData meetup, please contact the local group organizers (message us on the meetup page). Please also submit a report of any potential Code of Conduct violation directly to NumFOCUS (https://numfocus.typeform.com/to/ynjGdT).
Twitter: @PyDataBristol
Code of Conduct
PyData is dedicated to providing a harassment-free meeting experience for everyone, regardless of gender, sexual orientation, gender identity and expression, disability, physical appearance, body size, race, or religion. We do not tolerate harassment of meeting participants in any form.
All communication should be appropriate for a professional audience including people of many different backgrounds. Sexual language and imagery is not appropriate for any conference venue, including talks.
Be kind to others. Do not insult or put down other attendees. Behave professionally. Remember that harassment and sexist, racist, or exclusionary jokes are not appropriate for PyData.
To discuss any issues or concerns relating to the code of conduct or behavior of anyone at the PyData meetup
Please contact the local group organizers (message us on the meetup page). Please also submit a report of any potential Code of Conduct violation directly to NumFOCUS (https://numfocus.typeform.com/to/ynjGdT).
Sponsors
See allUpcoming events (1)
See all- PyData Bristol - 28th Meetup - 16th of May!Amdaris, Bristol
Date set!
Join us once again for the next PyData Bristol Meetup!
We’re meeting in a lovely venue Amdaris!! Big thank you for hosting our event this time.
Massive thanks to our other sponsor - Adlib for the scrumptious pizza, and thirst-quenching refreshments.
Here is an intro from out new hosts!Hi, We are Amdaris, an Insight company, and at our core we specialise in extending teams with highly skilled software experts. With bespoke Software Development, Product Design, Strategy and Consultation, Managed Services and Data Solutions, we seamlessly integrate into your business and culture, bringing passion, care, and technical proficiency directly to you.
Agenda for the evening:
🚪 6:00 pm - Doors open
🕡 6:30 pm - Talks commence (sharp!)
📚 Deep Dive 50 Minute Talk:- Better ETL with Managed Airflow in ADF by Niall Langley
📢 Community announcements
🤝 Relaxed networking over beers and soft drinks
Interested in sharing your knowledge or experience at this or a future event? Fill out this form to submit your talk proposal: PyData Bristol Talk Proposal
We look forward to seeing you there for another fantastic evening of Python, Data Science, and camaraderie!
# Talks
Better ETL with Managed Airflow in ADF by Niall Langley
Building complex data workflows using Azure Data Factory can get a little clunky - as you orchestration needs get more complex you hit limitations like not being able to nest loops or conditionals, running simple Python, bash or PowerShell scripts is difficult, and costs can grow quickly as you are charged per task execution. Recently another option become available, Managed Airflow in ADF.
Apace Airflow is a code-centric open-source platform for developing, scheduling and monitoring batch-based data workflows, built using the python language Data Engineers know and love. But until Managed Airflow, getting it working in Azure was a complex task for customers more used to PaaS services such as ADF, Databricks and Fabric. It is also an important ETL orchestrator on AWS and GCP, so cross cloud compatibility becomes simpler to achieve.
In this session we’ll look at what Airflow is, how it’s different from ADF, and what advantages Managed Airflow in ADF gives us. We talk about the idea of a DAG for building the workflow, and then work through some demos to show just how easy it is to use Python to write an Airflow DAG’s and import them into the Managed Airflow Environment as pipelines. We then dive into the excellent monitoring UI and find out just how easy is it to trigger a pipeline, view it to see the dependencies between tasks, and monitor runs.
By the end of the session attendees will have a good understanding of what Airflow is, when to use it, and how it fits into the Azure Data Platform.#
🕖 LOGISTICS
Talks kick off at 18:30 sharp; then networking in Left Handed Giant from 20:40.
If you realise you can't make it, please un-RSVP in good time to free up your place for your fellow community members.
Follow @pydatabristol (PyData Bristol (@PyDataBristol) / X) for updates on this and future events, as well as news from the global PyData community.
📜 CODE OF CONDUCT
The PyData Code of Conduct governs this meetup (Code of Conduct
). To discuss any issues or concerns relating to the code of conduct or behaviour of anyone at the PyData meetup, please contact the PyData Bristol organisers, or you can submit a report of any potential Code of Conduct violation directly to NumFOCUS (NumFOCUS Code of Conduct Report Form).## Speakers