<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Dagster Blog]]></title><description><![CDATA[The latest news and updates from Dagster]]></description><link>https://dagster.io/</link><generator>RSS for Node</generator><lastBuildDate>Sat, 11 Apr 2026 11:01:12 GMT</lastBuildDate><atom:link href="https://dagster.io/rss.xml" rel="self" type="application/rss+xml"/><language><![CDATA[en]]></language><item><title><![CDATA[The Rise of Medium Code]]></title><description><![CDATA[Why the reports of software’s demise are greatly exaggerated.]]></description><link>https://dagster.io/blog/the-rise-of-medium-code</link><guid isPermaLink="true">https://dagster.io/blog/the-rise-of-medium-code</guid><pubDate>Mon, 10 Jun 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Running Singer on Dagster]]></title><description><![CDATA[Singer Taps and Targets are popular data movement tools.  Here is how (and why) you run them in Dagster.]]></description><link>https://dagster.io/blog/dagster-singer</link><guid isPermaLink="true">https://dagster.io/blog/dagster-singer</guid><pubDate>Fri, 07 Jun 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[ELT Options in Dagster]]></title><description><![CDATA[Why running data ingestion jobs straight from the orchestrator is often a preferred approach.]]></description><link>https://dagster.io/blog/elt-options-in-dagster</link><guid isPermaLink="true">https://dagster.io/blog/elt-options-in-dagster</guid><pubDate>Wed, 05 Jun 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster’s Code Location Architecture]]></title><description><![CDATA[A structure for a reliable, maintainable data platform design.]]></description><link>https://dagster.io/blog/dagster-code-locations</link><guid isPermaLink="true">https://dagster.io/blog/dagster-code-locations</guid><pubDate>Tue, 28 May 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[What is Dagster: A Guide to the Data Orchestrator]]></title><description><![CDATA[Get to know the tool that sets the standard for modern data orchestration.]]></description><link>https://dagster.io/blog/what-is-dagster</link><guid isPermaLink="true">https://dagster.io/blog/what-is-dagster</guid><pubDate>Fri, 17 May 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Building Cost Effective AI Pipelines with OpenAI, LangChain, and Dagster]]></title><description><![CDATA[Leverage the power of LLMs while keeping the costs in check using the Dagster OpenAI integration.]]></description><link>https://dagster.io/blog/building-cost-effective-ai-pipelines-openai-langchain-dagster</link><guid isPermaLink="true">https://dagster.io/blog/building-cost-effective-ai-pipelines-openai-langchain-dagster</guid><pubDate>Wed, 08 May 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Unlocking Flexible Pipelines: Customizing the Asset Decorator]]></title><description><![CDATA[Use Asset Factories within Dagster to streamline data asset creation, promote code reusability, and maintain data engineering workflows.]]></description><link>https://dagster.io/blog/unlocking-flexible-pipelines-customizing-asset-decorator</link><guid isPermaLink="true">https://dagster.io/blog/unlocking-flexible-pipelines-customizing-asset-decorator</guid><pubDate>Tue, 30 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[See Both the Forest and the Trees with Dagster+ Insights]]></title><description><![CDATA[How Dagster+ Insights helps you control costs and elevate your data platform’s observability.]]></description><link>https://dagster.io/blog/see-the-forest-and-trees-dagster-plus</link><guid isPermaLink="true">https://dagster.io/blog/see-the-forest-and-trees-dagster-plus</guid><pubDate>Wed, 17 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Ensuring Reliable Data with Dagster+]]></title><description><![CDATA[Dagster+ helps you monitor the freshness, quality, and schema of your data.]]></description><link>https://dagster.io/blog/ensuring-reliable-data-dagster-plus</link><guid isPermaLink="true">https://dagster.io/blog/ensuring-reliable-data-dagster-plus</guid><pubDate>Wed, 17 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster+ Catalog: A New Built-in Asset Library for All Practitioners]]></title><description><![CDATA[Give your data teams a powerful new system of record without the overhead of maintaining a third-party catalog.]]></description><link>https://dagster.io/blog/dagster-plus-calatog-a-new-built-in-asset-library</link><guid isPermaLink="true">https://dagster.io/blog/dagster-plus-calatog-a-new-built-in-asset-library</guid><pubDate>Wed, 17 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Change Tracking Branch Deployments in Dagster+]]></title><description><![CDATA[Dagster+ further enhances identification and collaboration around changes to your data pipelines.]]></description><link>https://dagster.io/blog/change-tracking-branch-deployments-in-dagster-plus</link><guid isPermaLink="true">https://dagster.io/blog/change-tracking-branch-deployments-in-dagster-plus</guid><pubDate>Wed, 17 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Use Dagster and SkyPilot to Orchestrate Cost-Effective AI Training Jobs]]></title><description><![CDATA[Explore the efficient orchestration of AI training jobs with Dagster and SkyPilot.]]></description><link>https://dagster.io/blog/use-dagster-and-skypilot-to-orchestrate-cost-effective-ai-training-jobs</link><guid isPermaLink="true">https://dagster.io/blog/use-dagster-and-skypilot-to-orchestrate-cost-effective-ai-training-jobs</guid><pubDate>Thu, 11 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Data Engineering Impedance Mismatch]]></title><description><![CDATA[A case for asset-oriented over workflow-oriented in data orchestration.]]></description><link>https://dagster.io/blog/impedance-mismatch-in-data-orchestration</link><guid isPermaLink="true">https://dagster.io/blog/impedance-mismatch-in-data-orchestration</guid><pubDate>Wed, 10 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.7: Love Plus One]]></title><description><![CDATA[A major set of updates to Dagster Core ahead of our Dagster+ launch.]]></description><link>https://dagster.io/blog/dagster-1-7-love-plus-one</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-7-love-plus-one</guid><pubDate>Mon, 08 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Expanding the Dagster Embedded ELT Ecosystem with dltHub for Data Ingestion ]]></title><description><![CDATA[We now have an officially supported dlt integration.]]></description><link>https://dagster.io/blog/expanding-dagsters-embedded-elt-ecosystem-with-dlthub-for-data-ingestion</link><guid isPermaLink="true">https://dagster.io/blog/expanding-dagsters-embedded-elt-ecosystem-with-dlthub-for-data-ingestion</guid><pubDate>Fri, 05 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Sling Out Your ETL Provider with Embedded ELT]]></title><description><![CDATA[How we saved $40k and gained better control over our ingestion steps.]]></description><link>https://dagster.io/blog/sling-out-your-etl-provider-with-embedded-elt</link><guid isPermaLink="true">https://dagster.io/blog/sling-out-your-etl-provider-with-embedded-elt</guid><pubDate>Wed, 03 Apr 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Exploring The Data Engineering Lifecycle]]></title><description><![CDATA[Learn the fundamentals of a healthy data engineering lifecycle to optimize pipeline and asset production.]]></description><link>https://dagster.io/blog/the-data-engineering-lifecycle</link><guid isPermaLink="true">https://dagster.io/blog/the-data-engineering-lifecycle</guid><pubDate>Tue, 26 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[How Dagster Cloud Supports BCBS 239 Compliance]]></title><description><![CDATA[BCBS 239 establishes standards for banking risk management worldwide. Dagster helps data engineers meet these demanding standards.]]></description><link>https://dagster.io/blog/how-dagster-cloud-supports-bcbs-239-compliance</link><guid isPermaLink="true">https://dagster.io/blog/how-dagster-cloud-supports-bcbs-239-compliance</guid><pubDate>Fri, 22 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Integrate OpenAI calls into your pipelines]]></title><description><![CDATA[The new dagster-openai integration lets you tap into the power of LLMs in a cost-efficient way.]]></description><link>https://dagster.io/blog/dagster-openai</link><guid isPermaLink="true">https://dagster.io/blog/dagster-openai</guid><pubDate>Mon, 11 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Tech Talks Daily: Data, Decisions, and Dagster]]></title><description><![CDATA[Nick Schrock shares his blueprint for engineering excellence on the Tech Talks Daily Podcast.]]></description><link>https://dagster.io/blog/podcast-tech-talks-daily-nick-schrock-03-10-24</link><guid isPermaLink="true">https://dagster.io/blog/podcast-tech-talks-daily-nick-schrock-03-10-24</guid><pubDate>Sun, 10 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster University Presents: Dagster & dbt™]]></title><description><![CDATA[Learn how to combine your dbt™ knowledge with Dagster’s asset-focused approach for an enhanced data platform experience.]]></description><link>https://dagster.io/blog/dagster-university-presents-dagster-and-dbt</link><guid isPermaLink="true">https://dagster.io/blog/dagster-university-presents-dagster-and-dbt</guid><pubDate>Wed, 06 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[How to Make Data a Team Sport]]></title><description><![CDATA[Enabling internal access and collaboration around data in organizations is vital to tackling data complexity.]]></description><link>https://dagster.io/blog/how-to-make-data-a-team-sport</link><guid isPermaLink="true">https://dagster.io/blog/how-to-make-data-a-team-sport</guid><pubDate>Sat, 02 Mar 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Breaking Packages in Python]]></title><description><![CDATA[An exposé of the nooks and crannies of Python’s modules and packages.]]></description><link>https://dagster.io/blog/python-breaking-packages</link><guid isPermaLink="true">https://dagster.io/blog/python-breaking-packages</guid><pubDate>Tue, 27 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Balancing the Data Scales: Centralization vs. Decentralization]]></title><description><![CDATA[Learn how organizations can harness the strengths of both approaches to optimize their data operations.]]></description><link>https://dagster.io/blog/balancing-the-data-scales-centralization-vs-decentralization</link><guid isPermaLink="true">https://dagster.io/blog/balancing-the-data-scales-centralization-vs-decentralization</guid><pubDate>Fri, 23 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[BenchSci: A Leap Forward with Dagster]]></title><description><![CDATA[Learn about how BenchSci uses Dagster in their journey to expedite drug development.]]></description><link>https://dagster.io/blog/benchsci-leap-forward-with-dagster</link><guid isPermaLink="true">https://dagster.io/blog/benchsci-leap-forward-with-dagster</guid><pubDate>Tue, 20 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[A Geek Leader: Interview with Nick Schrock]]></title><description><![CDATA[John Rouda interviewed Nick Schrock, Founder of Dagster Labs, on open-source, ML, and the future of Dagster.]]></description><link>https://dagster.io/blog/podcast-a-geek-leader-nick-schrock</link><guid isPermaLink="true">https://dagster.io/blog/podcast-a-geek-leader-nick-schrock</guid><pubDate>Sat, 17 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Addressing Big Complexity Through Strategic Orchestration]]></title><description><![CDATA[For organizations looking to thrive in the era of Big Complexity, it’s time to reassess the role of orchestration in their data operations.]]></description><link>https://dagster.io/blog/addressing-big-complexity-strategic-orchestration</link><guid isPermaLink="true">https://dagster.io/blog/addressing-big-complexity-strategic-orchestration</guid><pubDate>Thu, 15 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Scaling Data Pipelines]]></title><description><![CDATA[Nick joins the Open Source Underdogs podcast for a conversation on how Dagster Labs is evolving.]]></description><link>https://dagster.io/blog/podcast-scaling-data-pipelines-feb-2024</link><guid isPermaLink="true">https://dagster.io/blog/podcast-scaling-data-pipelines-feb-2024</guid><pubDate>Wed, 14 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Standardize Pipelines with Domain-Specific Languages]]></title><description><![CDATA[By implementing DSLs, data teams can open their data platform to many more users without compromising on standards.]]></description><link>https://dagster.io/blog/scale-and-standardize-data-pipelines-with-dsl</link><guid isPermaLink="true">https://dagster.io/blog/scale-and-standardize-data-pipelines-with-dsl</guid><pubDate>Thu, 08 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Learning and Sharing in Public]]></title><description><![CDATA[On the culture of learning and sharing in Data Engineering.]]></description><link>https://dagster.io/blog/podcast-partially-redacted-pedram-feb-2024</link><guid isPermaLink="true">https://dagster.io/blog/podcast-partially-redacted-pedram-feb-2024</guid><pubDate>Wed, 07 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Facebook Eng Culture & Modern Data Stack Consolidation]]></title><description><![CDATA[On open source software, data, and understanding Facebook’s high performance culture.]]></description><link>https://dagster.io/blog/podcast-software-snack-bites-feb-2024</link><guid isPermaLink="true">https://dagster.io/blog/podcast-software-snack-bites-feb-2024</guid><pubDate>Tue, 06 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Thinking in Assets]]></title><description><![CDATA[How to develop data pipelines using Software-defined Assets.]]></description><link>https://dagster.io/blog/thinking-in-assets</link><guid isPermaLink="true">https://dagster.io/blog/thinking-in-assets</guid><pubDate>Mon, 05 Feb 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[What Dagster Believes About Data Platforms]]></title><description><![CDATA[The beliefs that organizations adopt about the way their data platforms should function influence their outcomes. Here are ours.]]></description><link>https://dagster.io/blog/what-dagster-believes-about-data-platforms</link><guid isPermaLink="true">https://dagster.io/blog/what-dagster-believes-about-data-platforms</guid><pubDate>Mon, 29 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Data Driven - The Role of AI and LLMs in Data]]></title><description><![CDATA[Pedram Navid joins the Data Driven podcast to discuss the role of AI and LLMs in data.]]></description><link>https://dagster.io/blog/podcast-datadriven-pedram-part-2</link><guid isPermaLink="true">https://dagster.io/blog/podcast-datadriven-pedram-part-2</guid><pubDate>Fri, 26 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Data Driven - Cutting Through the Noise of Data Products]]></title><description><![CDATA[Pedram Navid talks about how data teams can strategically enable self-service to speed up business decisions.]]></description><link>https://dagster.io/blog/podcast-datadriven-pedram-part-1</link><guid isPermaLink="true">https://dagster.io/blog/podcast-datadriven-pedram-part-1</guid><pubDate>Fri, 26 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.6: Back to Black]]></title><description><![CDATA[Major UI enhancements, Dagster Pipes upgrades and of course, dark mode :-)]]></description><link>https://dagster.io/blog/dagster-1-6-back-to-black</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-6-back-to-black</guid><pubDate>Fri, 12 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Retain.ai joins Dagster Labs]]></title><description><![CDATA[We’re excited and humbled to bring the Retain.ai organization into our fold to help build out Dagster’s data orchestration capabilities.]]></description><link>https://dagster.io/blog/dagster-labs-retain-ai</link><guid isPermaLink="true">https://dagster.io/blog/dagster-labs-retain-ai</guid><pubDate>Wed, 10 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Machine Learning Pipelines Are Still Data Pipelines]]></title><description><![CDATA[Sandy Ryza, Lead Engineer at Dagster Labs, talks data engineering for machine learning efforts.]]></description><link>https://dagster.io/blog/podcast-the-data-stack-show-jan-2024</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-data-stack-show-jan-2024</guid><pubDate>Wed, 03 Jan 2024 00:00:00 GMT</pubDate></item><item><title><![CDATA[Alter Everything - The Present & Future of Data Engineering]]></title><description><![CDATA[Nick Schrock joins the Alteryx podcast about data science and analytics culture.]]></description><link>https://dagster.io/blog/podcast-alter-everything</link><guid isPermaLink="true">https://dagster.io/blog/podcast-alter-everything</guid><pubDate>Thu, 21 Dec 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[How Dagster Labs runs Dagster: Open-Sourcing our Own Pipelines]]></title><description><![CDATA[A technical deep dive into the patterns and implementations of the Dagster Open Platform using our open-sourced code and dbt models.]]></description><link>https://dagster.io/blog/how-dagster-labs-runs-dagster</link><guid isPermaLink="true">https://dagster.io/blog/how-dagster-labs-runs-dagster</guid><pubDate>Mon, 04 Dec 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Scaling Dagster’s DAG Visualization to Handle Tens of Thousands of Assets]]></title><description><![CDATA[How the Dagster frontend team rapidly scaled Dagster’s DAG visualization for enterprise-sized data asset graphs.]]></description><link>https://dagster.io/blog/scaling-dag-visualization</link><guid isPermaLink="true">https://dagster.io/blog/scaling-dag-visualization</guid><pubDate>Wed, 29 Nov 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Abstracting Pipelines for Analysts with a YAML DSL]]></title><description><![CDATA[How SimpliSafe’s small engineering team uses YAML DSL within Dagster’s powerful data platform to support analysts and business stakeholders.]]></description><link>https://dagster.io/blog/simplisafe-case-study</link><guid isPermaLink="true">https://dagster.io/blog/simplisafe-case-study</guid><pubDate>Tue, 28 Nov 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[High-performance Python for Data Engineering]]></title><description><![CDATA[Learn how to optimize your Python data pipeline code to run faster with our high-performance Python guide for data engineers.]]></description><link>https://dagster.io/blog/python-high-performance</link><guid isPermaLink="true">https://dagster.io/blog/python-high-performance</guid><pubDate>Mon, 20 Nov 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[That Tech Pod]]></title><description><![CDATA[The Journey from Engineer to CEO and Lessons Learned Along the Way]]></description><link>https://dagster.io/blog/podcast-that-tech-pod</link><guid isPermaLink="true">https://dagster.io/blog/podcast-that-tech-pod</guid><pubDate>Tue, 14 Nov 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrate Unstructured Data Pipelines with Dagster and dlt]]></title><description><![CDATA[Load messy data sources into well-structured tables or datasets, through automatic schema inference and evolution.]]></description><link>https://dagster.io/blog/dagster-dlt</link><guid isPermaLink="true">https://dagster.io/blog/dagster-dlt</guid><pubDate>Wed, 08 Nov 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Craft Of Open Source: a Flagsmith podcast]]></title><description><![CDATA[Pete Hunt discusses data orchestration, Dagster, and our onward journey.]]></description><link>https://dagster.io/blog/podcast-flagsmith</link><guid isPermaLink="true">https://dagster.io/blog/podcast-flagsmith</guid><pubDate>Tue, 31 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Data Unlocked: How to Work Effectively With Your Data Teams]]></title><description><![CDATA[Nick Schrock on the relationship between data engineering and go-to-market.]]></description><link>https://dagster.io/blog/podcast-data-unlocked</link><guid isPermaLink="true">https://dagster.io/blog/podcast-data-unlocked</guid><pubDate>Tue, 31 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[CI/CD and Data Pipeline Automation (with Git)]]></title><description><![CDATA[Learn how to automate data pipelines and deployments by integrating Git and CI/CD in our Python for data engineering series.]]></description><link>https://dagster.io/blog/python-ci-cd-automation</link><guid isPermaLink="true">https://dagster.io/blog/python-ci-cd-automation</guid><pubDate>Fri, 20 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Tech Trek Podcast: Open source data orchestration]]></title><description><![CDATA[Pete Hunt shares insights on the challenges in the data orchestration market, and why Dagster is open-source.]]></description><link>https://dagster.io/blog/podcast-the-tech-trek</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-tech-trek</guid><pubDate>Thu, 19 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dagster Pipes]]></title><description><![CDATA[A new protocol and toolkit for integrating and launching compute into remote execution environments from Dagster.]]></description><link>https://dagster.io/blog/dagster-pipes</link><guid isPermaLink="true">https://dagster.io/blog/dagster-pipes</guid><pubDate>Fri, 13 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing External Assets]]></title><description><![CDATA[Use Dagster’s External Assets feature for data observability, lineage, data quality, and cataloging while bringing your own orchestration and scheduling.]]></description><link>https://dagster.io/blog/dagster-external-assets</link><guid isPermaLink="true">https://dagster.io/blog/dagster-external-assets</guid><pubDate>Fri, 13 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Stop Reinventing Orchestration: Embedded ELT in the Orchestrator]]></title><description><![CDATA[Solve data ingestion issues with Dagster's Embedded ELT feature, a lightweight embedded library.]]></description><link>https://dagster.io/blog/dagster-embedded-elt</link><guid isPermaLink="true">https://dagster.io/blog/dagster-embedded-elt</guid><pubDate>Thu, 12 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Improving the Dagster learning curve]]></title><description><![CDATA[Learn Dagster essentials and build asset-based data pipelines with Dagster University, our new self-guided course for beginners.]]></description><link>https://dagster.io/blog/announcing-dagster-university</link><guid isPermaLink="true">https://dagster.io/blog/announcing-dagster-university</guid><pubDate>Wed, 11 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Improving visibility into data operations with Dagster Insights]]></title><description><![CDATA[Gain operational observability on your data pipelines and bring cloud costs back under control with the Dagster Insights feature.]]></description><link>https://dagster.io/blog/dagster-insights</link><guid isPermaLink="true">https://dagster.io/blog/dagster-insights</guid><pubDate>Tue, 10 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Asset Checks]]></title><description><![CDATA[Deliver high-quality data with Dagster Asset Checks, the ability to embed data quality checks into your data pipeline.]]></description><link>https://dagster.io/blog/dagster-asset-checks</link><guid isPermaLink="true">https://dagster.io/blog/dagster-asset-checks</guid><pubDate>Mon, 09 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Orchestration Layer as the Data Platform Control Plane]]></title><description><![CDATA[Nick Schrock, founder and CTO of Dagster Labs, on The Data Stack Show.]]></description><link>https://dagster.io/blog/podcast-datastack-oct-2023</link><guid isPermaLink="true">https://dagster.io/blog/podcast-datastack-oct-2023</guid><pubDate>Wed, 04 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.5: How Will I Know?]]></title><description><![CDATA[Ahead of Launch Week, we are proud to be rolling out some exciting new capabilities.]]></description><link>https://dagster.io/blog/dagster-1-5-how-will-i-know</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-5-how-will-i-know</guid><pubDate>Mon, 02 Oct 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Write-Audit-Publish in data pipelines]]></title><description><![CDATA[We look at the write-audit-publish software design pattern used in ETL to ensure quality and reliability in data engineering workflows.]]></description><link>https://dagster.io/blog/python-write-audit-publish</link><guid isPermaLink="true">https://dagster.io/blog/python-write-audit-publish</guid><pubDate>Fri, 29 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Escaping the Modern Data Trap]]></title><description><![CDATA[Launch Week kicks off October 9th with new functionality being shared each day. Our theme: Escaping the Modern Data Trap!]]></description><link>https://dagster.io/blog/dagster-escaping-the-modern-data-trap</link><guid isPermaLink="true">https://dagster.io/blog/dagster-escaping-the-modern-data-trap</guid><pubDate>Thu, 28 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Bringing Great Developer Experience to Data Teams]]></title><description><![CDATA[Nick Schrock on how Dagster is bringing software engineering principles to the data space, and what a great developer experience means for data engineers.]]></description><link>https://dagster.io/blog/podcast-oss-startup-09-21-23</link><guid isPermaLink="true">https://dagster.io/blog/podcast-oss-startup-09-21-23</guid><pubDate>Thu, 21 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Pedram Navid: Why I Joined Dagster Labs]]></title><description><![CDATA[It is not every day you get to join a company working on building a product purpose-built for you.]]></description><link>https://dagster.io/blog/pedram-why-i-joined-dagster-labs</link><guid isPermaLink="true">https://dagster.io/blog/pedram-why-i-joined-dagster-labs</guid><pubDate>Wed, 20 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[A Dagster-Powered Spam Filter]]></title><description><![CDATA[Using Dagster, you can maintain data trust and protect the integrity of any user-generated service with this powerful spam filter.]]></description><link>https://dagster.io/blog/dagster-spam-filter</link><guid isPermaLink="true">https://dagster.io/blog/dagster-spam-filter</guid><pubDate>Thu, 14 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Code Story]]></title><description><![CDATA[Pete Hunt joins Noah Labhart - startup founder & CTO - to discuss the origin story of Dagster.]]></description><link>https://dagster.io/blog/podcast-code-story</link><guid isPermaLink="true">https://dagster.io/blog/podcast-code-story</guid><pubDate>Wed, 13 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Data Orchestration in an Increasingly Complex Data Ecosystem]]></title><description><![CDATA[Nick Schrock shares his perspective on the state of data orchestration technology and its application to help inform its implementation in your environment.]]></description><link>https://dagster.io/blog/podcast-data-eng-09-10-23</link><guid isPermaLink="true">https://dagster.io/blog/podcast-data-eng-09-10-23</guid><pubDate>Sun, 10 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Factory Patterns in Python]]></title><description><![CDATA[We explore design patterns — reusable solutions to common problems in software design — as used in data engineering, specifically factory patterns in Python.]]></description><link>https://dagster.io/blog/python-factory-patterns</link><guid isPermaLink="true">https://dagster.io/blog/python-factory-patterns</guid><pubDate>Mon, 04 Sep 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Migrating off dbt Cloud™]]></title><description><![CDATA[Looking for an alternative tool to orchestrate your dbt projects? Here’s a step-by-step guide to migrating from dbt Cloud to Dagster.]]></description><link>https://dagster.io/blog/migrate-off-dbt-cloud</link><guid isPermaLink="true">https://dagster.io/blog/migrate-off-dbt-cloud</guid><pubDate>Tue, 29 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Breakthrough Hiring Show with Pete Hunt]]></title><description><![CDATA[Pete and host James Mackey discuss strategic hiring for startups and the dangers of getting too big too fast.]]></description><link>https://dagster.io/blog/podcast-the-breakthrough-hiring-show</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-breakthrough-hiring-show</guid><pubDate>Mon, 28 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[ML pipelines for fine-tuning LLMs]]></title><description><![CDATA[LLM fine-tuning best practices for creating a clean production ML pipeline, streamlining model training, and operationalizing fine-tuned LLMs.]]></description><link>https://dagster.io/blog/finetuning-llms</link><guid isPermaLink="true">https://dagster.io/blog/finetuning-llms</guid><pubDate>Mon, 28 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Happy Engineer Podcast: Engineering Hard Choices]]></title><description><![CDATA[Pete Hunt shares insights on building and leading a data engineering team and making hard engineering calls.]]></description><link>https://dagster.io/blog/podcast-the-happy-engineer</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-happy-engineer</guid><pubDate>Thu, 24 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Adventures in DevOps]]></title><description><![CDATA[Testing and Development in the Data Domain]]></description><link>https://dagster.io/blog/podcast-adventures-in-devops</link><guid isPermaLink="true">https://dagster.io/blog/podcast-adventures-in-devops</guid><pubDate>Thu, 24 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dagster Labs]]></title><description><![CDATA[In the spirit of simplification, the company formerly known as Elementl is now doing business as Dagster Labs.]]></description><link>https://dagster.io/blog/introducing-dagster-labs</link><guid isPermaLink="true">https://dagster.io/blog/introducing-dagster-labs</guid><pubDate>Mon, 21 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Building an Outbound Reporting Pipeline]]></title><description><![CDATA[Learn how to use data engineering patterns and Dagster’s dynamic partitioning to build an outbound email report delivery pipeline.]]></description><link>https://dagster.io/blog/outbound-reporting-pipeline</link><guid isPermaLink="true">https://dagster.io/blog/outbound-reporting-pipeline</guid><pubDate>Fri, 18 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Parallel Computing on Dagster with Dask]]></title><description><![CDATA[Orchestrate your Dask computations and make your pipelines faster for larger data engineering and machine learning tasks.]]></description><link>https://dagster.io/blog/dagster-dask</link><guid isPermaLink="true">https://dagster.io/blog/dagster-dask</guid><pubDate>Mon, 14 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Type Hinting in Python]]></title><description><![CDATA[In part VI of our Data Engineering with Python series, we explore type hinting functions and classes, and how type hints reduce errors.]]></description><link>https://dagster.io/blog/python-type-hinting</link><guid isPermaLink="true">https://dagster.io/blog/python-type-hinting</guid><pubDate>Fri, 11 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Environment Variables in Python]]></title><description><![CDATA[In part V of our series on Data Engineering with Python, we cover best practices for managing environment variables in Python.]]></description><link>https://dagster.io/blog/python-environment-variables</link><guid isPermaLink="true">https://dagster.io/blog/python-environment-variables</guid><pubDate>Mon, 07 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Whats New in Data]]></title><description><![CDATA[Data Orchestration, Dagster, and parallels to React.js]]></description><link>https://dagster.io/blog/podcast-whats-new-in-data</link><guid isPermaLink="true">https://dagster.io/blog/podcast-whats-new-in-data</guid><pubDate>Thu, 03 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Drill to Detail: Dagster, Orchestration and Software-Defined Assets]]></title><description><![CDATA[Dagster Labs founder Nick Shrock is interviewed by Rittman Analytics founder Mark Rittman]]></description><link>https://dagster.io/blog/podcast-drill-to-detail-Aug-2023</link><guid isPermaLink="true">https://dagster.io/blog/podcast-drill-to-detail-Aug-2023</guid><pubDate>Thu, 03 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Scale Up Show: Interview with Pete Hunt]]></title><description><![CDATA[Ryan Staley interviewed Pete Hunt on how his experience at Facebook and Twitter is guiding his leadership of Dagster.]]></description><link>https://dagster.io/blog/podcast-the-scale-up-show</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-scale-up-show</guid><pubDate>Wed, 02 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrating dbt™ with Dagster]]></title><description><![CDATA[Orchestrate dbt with Dagster’s popular dbt integration, now with major enhancements to supercharge your dbt models as part of your data pipeline.]]></description><link>https://dagster.io/blog/orchestrating-dbt-with-dagster</link><guid isPermaLink="true">https://dagster.io/blog/orchestrating-dbt-with-dagster</guid><pubDate>Tue, 01 Aug 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Speeding up the dbt™ docs by 20x with React Server Components]]></title><description><![CDATA[dbt docs slow? See how we dropped page load time and memory usage for a large dbt project by 20x using React Server Components.]]></description><link>https://dagster.io/blog/dbt-docs-on-react</link><guid isPermaLink="true">https://dagster.io/blog/dbt-docs-on-react</guid><pubDate>Mon, 31 Jul 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[A Geek Leader: Interview with Pete Hunt]]></title><description><![CDATA[John Rouda interviewed Pete Hunt, CEO of Dagster Labs, on React.js, open source and data orchestration.]]></description><link>https://dagster.io/blog/podcast-a-geek-leader</link><guid isPermaLink="true">https://dagster.io/blog/podcast-a-geek-leader</guid><pubDate>Mon, 24 Jul 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.4: Material Girl]]></title><description><![CDATA[The latest release brings major new dbt capabilities, new asset materialization controls, and more.]]></description><link>https://dagster.io/blog/dagster-1-4-material-girl</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-4-material-girl</guid><pubDate>Fri, 21 Jul 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Asset-Based Data Orchestration (from Data + AI Summit)]]></title><description><![CDATA[An overview of Dagster's asset-based orchestration approach, with data freshness sensors to trigger pipelines.]]></description><link>https://dagster.io/blog/asset-based-scheduling</link><guid isPermaLink="true">https://dagster.io/blog/asset-based-scheduling</guid><pubDate>Thu, 06 Jul 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[LLM training pipelines with Langchain, Airbyte, and Dagster]]></title><description><![CDATA[This tutorial shows you how to combine Langchain, Airbyte, and Dagster to build maintainable and scalable pipelines for training LLMs.]]></description><link>https://dagster.io/blog/training-llms</link><guid isPermaLink="true">https://dagster.io/blog/training-llms</guid><pubDate>Wed, 05 Jul 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Two New Self-Serve Plans for Dagster Cloud]]></title><description><![CDATA['Solo' and 'Team' plans, with event-based pricing, will replace the old compute-duration based plan. We explain why we are making this change.]]></description><link>https://dagster.io/blog/new-standard-plans</link><guid isPermaLink="true">https://dagster.io/blog/new-standard-plans</guid><pubDate>Mon, 26 Jun 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Revisiting the Poor Man’s Data Lake with MotherDuck]]></title><description><![CDATA[See how much easier you can collaborate using DuckDB’s high-powered cloud version MotherDuck to build a one-system data lake.]]></description><link>https://dagster.io/blog/poor-mans-datalake-motherduck</link><guid isPermaLink="true">https://dagster.io/blog/poor-mans-datalake-motherduck</guid><pubDate>Thu, 22 Jun 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Dagster Master Plan]]></title><description><![CDATA[Elementl CEO Pete Hunt shares the three priorities that guide how we will evolve Dagster.]]></description><link>https://dagster.io/blog/dagster-master-plan</link><guid isPermaLink="true">https://dagster.io/blog/dagster-master-plan</guid><pubDate>Thu, 15 Jun 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Backfills in Data & Machine Learning: A Primer]]></title><description><![CDATA[A step-by-step guide to using backfills and partitions to make data management more simple for data & ML engineers.]]></description><link>https://dagster.io/blog/backfills-in-ml</link><guid isPermaLink="true">https://dagster.io/blog/backfills-in-ml</guid><pubDate>Tue, 06 Jun 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Data Platform Podcast: Orchestration & Psychology featuring Pete Hunt]]></title><description><![CDATA[Jason and Iva are joined by Pete Hunt, CEO of Elementl, to discuss orchestration tools and the psychology of companies.]]></description><link>https://dagster.io/blog/podcast-data-platform</link><guid isPermaLink="true">https://dagster.io/blog/podcast-data-platform</guid><pubDate>Wed, 31 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Elementl Raises $33 Million in Series B Funding to Accelerate Data Orchestration and Unleash Advanced Data Use Cases]]></title><description><![CDATA[The new capital will accelerate the development and adoption of Dagster, the open-source, cloud-native data orchestrator.]]></description><link>https://dagster.io/blog/elementl-series-b</link><guid isPermaLink="true">https://dagster.io/blog/elementl-series-b</guid><pubDate>Wed, 24 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster and the Decade of Data Engineering]]></title><description><![CDATA[We are pleased to announce Elementl's $33M Series B and share our vision for what's next for Dagster and the practice of data engineering.]]></description><link>https://dagster.io/blog/decade-of-data-engineering</link><guid isPermaLink="true">https://dagster.io/blog/decade-of-data-engineering</guid><pubDate>Wed, 24 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Building Better Analytics Pipelines]]></title><description><![CDATA[A recap of our live event on the benefits and techniques for orchestrating analytics pipelines.]]></description><link>https://dagster.io/blog/building-better-analytics-pipelines</link><guid isPermaLink="true">https://dagster.io/blog/building-better-analytics-pipelines</guid><pubDate>Tue, 23 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dynamic Definitions for Flexible Asset Partitioning]]></title><description><![CDATA[Dagster’s dynamic partition definitions allow engineers to use the power of partitions in a broader range of scenarios.]]></description><link>https://dagster.io/blog/dynamic-partitioning</link><guid isPermaLink="true">https://dagster.io/blog/dynamic-partitioning</guid><pubDate>Fri, 19 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Deciphering Arcane Kubernetes and ECS Errors with Dagster]]></title><description><![CDATA[Recent enhancements allow Dagster to surface clearer and more actionable errors to accelerate your development cycles.]]></description><link>https://dagster.io/blog/surfacing-errors</link><guid isPermaLink="true">https://dagster.io/blog/surfacing-errors</guid><pubDate>Wed, 17 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Config Systems: Airflow and Dagster]]></title><description><![CDATA[Contrasting the Airflow and Dagster configuration systems by rewriting the Airflow Slack Integration.]]></description><link>https://dagster.io/blog/config-systems-airflow-vs-dagster</link><guid isPermaLink="true">https://dagster.io/blog/config-systems-airflow-vs-dagster</guid><pubDate>Tue, 16 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[How to Maintain High Product & Code Quality As Your Startup Scales]]></title><description><![CDATA[Raising the quality bar requires process adjustments and a cultural shift.]]></description><link>https://dagster.io/blog/product-and-code-quality</link><guid isPermaLink="true">https://dagster.io/blog/product-and-code-quality</guid><pubDate>Tue, 09 May 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.3: Smooth Operator]]></title><description><![CDATA[Dagster 1.3 officially inducts Pythonic Config and Resources and brings new enhancements to Software-Defined Assets, integrations, documentation, and guides.]]></description><link>https://dagster.io/blog/dagster-1-3-smooth-operator</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-3-smooth-operator</guid><pubDate>Wed, 26 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Catalyst Cooperative: Liberating Public Utility Data with Dagster]]></title><description><![CDATA[The PUDL Project cleans and distributes analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.]]></description><link>https://dagster.io/blog/catalyst-cooperative-case-study</link><guid isPermaLink="true">https://dagster.io/blog/catalyst-cooperative-case-study</guid><pubDate>Fri, 21 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[From Python Projects to Dagster Pipelines]]></title><description><![CDATA[In part IV of our series, we explore setting up a Dagster project, and the key concept of Data Assets.]]></description><link>https://dagster.io/blog/data-engineering-in-python</link><guid isPermaLink="true">https://dagster.io/blog/data-engineering-in-python</guid><pubDate>Fri, 14 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Enabling Large-scale, Multi-cloud Computing with Dagster]]></title><description><![CDATA[Abstracting away infrastructure concerns in large-scale computing with conditional multi-cloud processing.]]></description><link>https://dagster.io/blog/empirico-case-study</link><guid isPermaLink="true">https://dagster.io/blog/empirico-case-study</guid><pubDate>Mon, 10 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrate Meltano Jobs with Dagster]]></title><description><![CDATA[Meltano provides 550 connectors and tools, all of which can be configured and orchestrated straight from Dagster.]]></description><link>https://dagster.io/blog/dagster-meltano-integration-tutorial</link><guid isPermaLink="true">https://dagster.io/blog/dagster-meltano-integration-tutorial</guid><pubDate>Tue, 04 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Community Memo: Pythonic Config and Resources]]></title><description><![CDATA[Major ergonomic improvements are coming to Dagster's config and resources systems, including a Pydantic frontend.]]></description><link>https://dagster.io/blog/pythonic-config-and-resources</link><guid isPermaLink="true">https://dagster.io/blog/pythonic-config-and-resources</guid><pubDate>Mon, 03 Apr 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Best Practices in Structuring Python Projects]]></title><description><![CDATA[We cover 9 best practices and examples on structuring your Python projects for collaboration and productivity.]]></description><link>https://dagster.io/blog/python-project-best-practices</link><guid isPermaLink="true">https://dagster.io/blog/python-project-best-practices</guid><pubDate>Tue, 21 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Partitions in Data Pipelines]]></title><description><![CDATA[Partitioning is a technique that helps data engineers and ML engineers organize data and the computations that produce that data.]]></description><link>https://dagster.io/blog/partitioned-data-pipelines</link><guid isPermaLink="true">https://dagster.io/blog/partitioned-data-pipelines</guid><pubDate>Mon, 20 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Tracking the Fake GitHub Star Black Market with Dagster, dbt and BigQuery]]></title><description><![CDATA[It's easy for an open-source project to buy fake GitHub stars. We share two approaches for detecting them.]]></description><link>https://dagster.io/blog/fake-stars</link><guid isPermaLink="true">https://dagster.io/blog/fake-stars</guid><pubDate>Thu, 16 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.2: Formation]]></title><description><![CDATA[Enhanced partitioned asset support and the introduction of Pythonic config and resources, and integration updates.]]></description><link>https://dagster.io/blog/dagster-1-2-formation</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-2-formation</guid><pubDate>Thu, 09 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[How We Deploy 5X Faster with Warm Docker Containers]]></title><description><![CDATA[Using pex, Serverless Dagster Cloud now deploys 4 to 5 times faster by avoiding the overhead of building and launching Docker images.]]></description><link>https://dagster.io/blog/fast-deploys-with-pex-and-docker</link><guid isPermaLink="true">https://dagster.io/blog/fast-deploys-with-pex-and-docker</guid><pubDate>Tue, 07 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Python Packages: a Primer for Data People (part 2 of 2)]]></title><description><![CDATA[An introduction to managing Python dependencies and some virtual environment best practices.]]></description><link>https://dagster.io/blog/python-packages-primer-2</link><guid isPermaLink="true">https://dagster.io/blog/python-packages-primer-2</guid><pubDate>Mon, 06 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Python Packages: a Primer for Data People (part 1 of 2)]]></title><description><![CDATA[The foundation of a solid Python project is mastering modules, packages and imports.]]></description><link>https://dagster.io/blog/python-packages-primer-1</link><guid isPermaLink="true">https://dagster.io/blog/python-packages-primer-1</guid><pubDate>Mon, 06 Mar 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster Integrations Update]]></title><description><![CDATA[Dagster offers 47 integrations to accelerate your development, and we are working hard to expand and enhance them.]]></description><link>https://dagster.io/blog/dagster-integrations-update-feb-2023</link><guid isPermaLink="true">https://dagster.io/blog/dagster-integrations-update-feb-2023</guid><pubDate>Tue, 28 Feb 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Migrating from Airflow to Dagster is now a Breeze]]></title><description><![CDATA[The newly released `dagster-airflow` library has made migrating off legacy Airflow and onto Dagster much easier.]]></description><link>https://dagster.io/blog/dagster-airflow-migration</link><guid isPermaLink="true">https://dagster.io/blog/dagster-airflow-migration</guid><pubDate>Wed, 08 Feb 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Build a GitHub Support Bot with GPT3, LangChain, and Python]]></title><description><![CDATA[In this tutorial, we tap into the power of OpenAI's ChatGPT to build a GitHub support bot using GPT3, LangChain, and Python.]]></description><link>https://dagster.io/blog/chatgpt-langchain</link><guid isPermaLink="true">https://dagster.io/blog/chatgpt-langchain</guid><pubDate>Mon, 09 Jan 2023 00:00:00 GMT</pubDate></item><item><title><![CDATA[Converting an ETL Script to Software-Defined Assets]]></title><description><![CDATA[Lets talk about moving from an ETL script to a robust Dagster pipeline using Software-Defined Assets.]]></description><link>https://dagster.io/blog/dagster-script-to-assets</link><guid isPermaLink="true">https://dagster.io/blog/dagster-script-to-assets</guid><pubDate>Thu, 22 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Bringing Declarative Scheduling to dbt with Dagster]]></title><description><![CDATA[Declarative Scheduling takes the orchestration of dbt models as part of a larger pipeline to an entirely new level.]]></description><link>https://dagster.io/blog/declarative-scheduling-for-dbt</link><guid isPermaLink="true">https://dagster.io/blog/declarative-scheduling-for-dbt</guid><pubDate>Fri, 16 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 1.1: Thank U, Next]]></title><description><![CDATA[A major release with Declarative Scheduling, multi-asset scheduling, and SDA partitioning. Plus Secrets management, Dagit enhancements, Integrations updates and more...]]></description><link>https://dagster.io/blog/dagster-1-1-thank-u-next</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-1-thank-u-next</guid><pubDate>Wed, 14 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Declarative Scheduling for Data Assets]]></title><description><![CDATA[Keep data assets up-to-date and determine whether source data has changed with declarative asset-based scheduling.]]></description><link>https://dagster.io/blog/declarative-scheduling</link><guid isPermaLink="true">https://dagster.io/blog/declarative-scheduling</guid><pubDate>Thu, 08 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Evaluating Dagster for Better Skiing - and a New Job]]></title><description><![CDATA[How quickstart projects snowball into new careers. A common data PoC walkthrough with Dagster.]]></description><link>https://dagster.io/blog/learning-dagster-snowreport</link><guid isPermaLink="true">https://dagster.io/blog/learning-dagster-snowreport</guid><pubDate>Wed, 07 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Build More Reliable Machine Learning Systems]]></title><description><![CDATA[Sandy Ryza explains how his background in machine learning has informed his work on the Dagster project.]]></description><link>https://dagster.io/blog/podcast-the-machine-learning-podcast-dec-1-2022</link><guid isPermaLink="true">https://dagster.io/blog/podcast-the-machine-learning-podcast-dec-1-2022</guid><pubDate>Thu, 01 Dec 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Getting Stuff Done: a Guide to Productive Software Engineering]]></title><description><![CDATA[To be a more productive software engineer you need to master changes, how these affect the program and others on the team.]]></description><link>https://dagster.io/blog/productive-software-engineering</link><guid isPermaLink="true">https://dagster.io/blog/productive-software-engineering</guid><pubDate>Wed, 30 Nov 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Safe and Easy: Managing Secrets in Dagster Cloud]]></title><description><![CDATA[Dagster Cloud’s new Environment Variables UI makes it easy to set up scoped environment variables.]]></description><link>https://dagster.io/blog/dagster-managing-secrets</link><guid isPermaLink="true">https://dagster.io/blog/dagster-managing-secrets</guid><pubDate>Mon, 21 Nov 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[My Path to Elementl - Part 2]]></title><description><![CDATA[Pete Hunt takes over as CEO as Nick Schrock takes on the CTO role.]]></description><link>https://dagster.io/blog/pete-hunt-path-to-elementl-part2</link><guid isPermaLink="true">https://dagster.io/blog/pete-hunt-path-to-elementl-part2</guid><pubDate>Fri, 18 Nov 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Pushing REST-API data to Google Sheets with Dagster]]></title><description><![CDATA[A total beginners tutorial in which we store REST API data in Google Sheets and learn some key abstractions.]]></description><link>https://dagster.io/blog/dagster-google-sheets-tutorial</link><guid isPermaLink="true">https://dagster.io/blog/dagster-google-sheets-tutorial</guid><pubDate>Fri, 11 Nov 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Adding Types to a Large Python Codebase]]></title><description><![CDATA[What we learned when we introduced dynamically typed code to a large Python codebase, bringing Dagster's public API to 100% type coverage.]]></description><link>https://dagster.io/blog/adding-python-types</link><guid isPermaLink="true">https://dagster.io/blog/adding-python-types</guid><pubDate>Mon, 07 Nov 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrating Machine Learning Pipelines with Dagster]]></title><description><![CDATA[How to use Dagster’s open source data orchestrator to build machine learning pipelines and train ML models.]]></description><link>https://dagster.io/blog/dagster-ml-pipelines</link><guid isPermaLink="true">https://dagster.io/blog/dagster-ml-pipelines</guid><pubDate>Mon, 31 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrating Data Science at Zephyr AI]]></title><description><![CDATA[Zephyr AI applies data science to massive datasets of DNA and healthcare records to deliver novel AI-driven insights.]]></description><link>https://dagster.io/blog/zephyr-ai-case-study</link><guid isPermaLink="true">https://dagster.io/blog/zephyr-ai-case-study</guid><pubDate>Thu, 27 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Build a poor man’s data lake from scratch with DuckDB]]></title><description><![CDATA[DuckDB is so hot right now. Learn how to build a data lake from dbt using DuckDB for SQL transformations, along with Python, Dagster, and Parquet files.]]></description><link>https://dagster.io/blog/duckdb-data-lake</link><guid isPermaLink="true">https://dagster.io/blog/duckdb-data-lake</guid><pubDate>Tue, 25 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Unreasonable Effectiveness of Data Pipeline Smoke Tests]]></title><description><![CDATA[Data practitioners waste time writing unit tests to catch bugs they could have caught with smoke tests.]]></description><link>https://dagster.io/blog/smoke-test-data-pipeline</link><guid isPermaLink="true">https://dagster.io/blog/smoke-test-data-pipeline</guid><pubDate>Wed, 19 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Web Workers are not the Answer]]></title><description><![CDATA[A tale of overstretched logs, counterintuitive web worker behavior, and ultimately a troublesome cursor issue.]]></description><link>https://dagster.io/blog/web-workers-performance-issue</link><guid isPermaLink="true">https://dagster.io/blog/web-workers-performance-issue</guid><pubDate>Mon, 17 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster at all 5 Steps of the Development Lifecycle]]></title><description><![CDATA[Dagster facilitates a data engineers work across all five steps in the development lifecycle.]]></description><link>https://dagster.io/blog/dagster-five-stages-development-lifecycle</link><guid isPermaLink="true">https://dagster.io/blog/dagster-five-stages-development-lifecycle</guid><pubDate>Sun, 16 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[A Dagster Crash Course]]></title><description><![CDATA[If you are looking to get up and running with Dagster in 10 minutes or less, this is a good place to start. Buckle up.]]></description><link>https://dagster.io/blog/dagster-crash-course-oct-2022</link><guid isPermaLink="true">https://dagster.io/blog/dagster-crash-course-oct-2022</guid><pubDate>Thu, 06 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Postgres: a Better Message Queue than Kafka?]]></title><description><![CDATA[When lots of event logs must be stored and indexed, Kafka is the obvious choice. Naturally, our queue runs on Postgres.]]></description><link>https://dagster.io/blog/skip-kafka-use-postgres-message-queue</link><guid isPermaLink="true">https://dagster.io/blog/skip-kafka-use-postgres-message-queue</guid><pubDate>Tue, 04 Oct 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster vs. Airflow]]></title><description><![CDATA[Looking for an Apache Airflow alternative? See why data teams choose Dagster for data orchestration in this five-part Dagster vs Airflow comparison guide.]]></description><link>https://dagster.io/blog/dagster-airflow</link><guid isPermaLink="true">https://dagster.io/blog/dagster-airflow</guid><pubDate>Tue, 20 Sep 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[How EvolutionIQ Rebuilt its ML Platform for Enormous Productivity.]]></title><description><![CDATA[A guide for CIOs/CTOs and engineering leaders looking to master the Modern Data Stack and develop a high performance data platform - while avoiding pitfalls along the way.]]></description><link>https://dagster.io/blog/evolution-iq-case-study</link><guid isPermaLink="true">https://dagster.io/blog/evolution-iq-case-study</guid><pubDate>Wed, 24 Aug 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Spend Less Time Debugging with Dagster]]></title><description><![CDATA[It’s not uncommon for a data engineer to devote 80% of their day to debugging. Dagster radically improves on this.]]></description><link>https://dagster.io/blog/dagster-debugging</link><guid isPermaLink="true">https://dagster.io/blog/dagster-debugging</guid><pubDate>Wed, 17 Aug 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Launching Dagster Cloud to GA]]></title><description><![CDATA[The enterprise orchestration platform that puts developer experience first: hybrid or serverless deployments, native branching, and out-of-the-box CI/CD.]]></description><link>https://dagster.io/blog/dagster-cloud-ga-launch</link><guid isPermaLink="true">https://dagster.io/blog/dagster-cloud-ga-launch</guid><pubDate>Tue, 09 Aug 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dagster 1.0: Hello]]></title><description><![CDATA[Announcing Dagster 1.0. - a stable foundation for building the orchestration layer for modern data platforms.]]></description><link>https://dagster.io/blog/dagster-1-0-hello</link><guid isPermaLink="true">https://dagster.io/blog/dagster-1-0-hello</guid><pubDate>Fri, 05 Aug 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Open Core Business Model]]></title><description><![CDATA[The relationship between Dagster, the open-source project, and Dagster Cloud, our hosted SaaS platform.]]></description><link>https://dagster.io/blog/open-core-business-model-dagster</link><guid isPermaLink="true">https://dagster.io/blog/open-core-business-model-dagster</guid><pubDate>Wed, 03 Aug 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster Cloud goes SOC 2]]></title><description><![CDATA[Elementl, the company behind the Dagster data orchestration tool achieves SOC2 compliance.]]></description><link>https://dagster.io/blog/soc2-compliance-dagster-blog</link><guid isPermaLink="true">https://dagster.io/blog/soc2-compliance-dagster-blog</guid><pubDate>Tue, 26 Jul 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster Day:  Announcing Dagster 1.0 and Dagster Cloud]]></title><description><![CDATA[The release of Dagster 1.0 and the GA launch of Dagster Cloud represent major milestones in the evolution of our orchestration solution.]]></description><link>https://dagster.io/blog/announcing-dagster-day</link><guid isPermaLink="true">https://dagster.io/blog/announcing-dagster-day</guid><pubDate>Mon, 25 Jul 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Roman Roads in Data Engineering: Don't Write Data Pipelines from Scratch]]></title><description><![CDATA[Work in a way that lays the foundation for your next data product while you're building your current one.]]></description><link>https://dagster.io/blog/roman-roads-assets-ops</link><guid isPermaLink="true">https://dagster.io/blog/roman-roads-assets-ops</guid><pubDate>Tue, 12 Jul 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[The Data Exchange: Software-defined Assets]]></title><description><![CDATA[Nick Schrock on software-defined assets, a new approach to managing, maintaining, and orchestrating data declaratively.]]></description><link>https://dagster.io/blog/podcast-software-defined-assets-06-23-2022</link><guid isPermaLink="true">https://dagster.io/blog/podcast-software-defined-assets-06-23-2022</guid><pubDate>Thu, 23 Jun 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[My Path to Elementl: Pete Hunt]]></title><description><![CDATA[Pete Hunt discusses what caused him to make the leap from Twitter to Elementl.]]></description><link>https://dagster.io/blog/pete-hunt-path-to-elementl</link><guid isPermaLink="true">https://dagster.io/blog/pete-hunt-path-to-elementl</guid><pubDate>Wed, 22 Jun 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Orchestrating Python and dbt with Dagster]]></title><description><![CDATA[How asset-focused orchestration bridges the gap between some of data's most popular tools.]]></description><link>https://dagster.io/blog/dagster-0-15-0-dbt-python</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-15-0-dbt-python</guid><pubDate>Mon, 20 Jun 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.15.0: Cool for the Summer]]></title><description><![CDATA[In 0.15.0, software-defined assets are now marked fully stable and are ready for primetime.]]></description><link>https://dagster.io/blog/dagster-0-15-0-cool-for-the-summer</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-15-0-cool-for-the-summer</guid><pubDate>Wed, 15 Jun 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[New in 0.14.0: Dagster-Airbyte Integration]]></title><description><![CDATA[0.14.0 introduces a deep integration with Airbyte: view Airbyte logs directly in Dagit, and every updated table will be recorded and tracked over time.]]></description><link>https://dagster.io/blog/dagster-0-14-0-airbyte</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-14-0-airbyte</guid><pubDate>Wed, 09 Mar 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Software-Defined Assets]]></title><description><![CDATA[Software-Defined Assets are a new abstraction that allows data teams to focus on the end products, not just the individual tasks, in their data pipeline.]]></description><link>https://dagster.io/blog/software-defined-assets</link><guid isPermaLink="true">https://dagster.io/blog/software-defined-assets</guid><pubDate>Tue, 01 Mar 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.14.0: Table Schema API + Pandera Integration]]></title><description><![CDATA[Introducing two asset observability-enhancing features: Table Schema API, and an integration with the dataframe validation library Pandera.]]></description><link>https://dagster.io/blog/dagster-0-14-0-table-schema-pandera</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-14-0-table-schema-pandera</guid><pubDate>Tue, 01 Mar 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.14.0: Never Felt Like This Before]]></title><description><![CDATA[We’re thrilled to release version 0.14.0 of Dagster. This version introduces much more mature version of software-defined assets, new integrations, a new homepage for Dagit, and a wide set of other features and improvements.]]></description><link>https://dagster.io/blog/dagster-0-14-0-never-felt-like-this-before</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-14-0-never-felt-like-this-before</guid><pubDate>Tue, 01 Mar 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Rebundling the Data Platform]]></title><description><![CDATA['The Unbundling of Airflow' argued that modern data stack solutions (data ingestion, data transformation, reverse ETL) manage their own data orchestration. Data teams need is a control plane for the modern data stack.]]></description><link>https://dagster.io/blog/rebundling-the-data-platform</link><guid isPermaLink="true">https://dagster.io/blog/rebundling-the-data-platform</guid><pubDate>Thu, 17 Feb 2022 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dagster Cloud]]></title><description><![CDATA[Dagster Cloud, the enterprise orchestration platform that puts developer experience first, with fully serverless or hybrid deployments, is now here.]]></description><link>https://dagster.io/blog/introducing-dagster-cloud</link><guid isPermaLink="true">https://dagster.io/blog/introducing-dagster-cloud</guid><pubDate>Thu, 02 Dec 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Laying the Foundation of your Data Platform for the Era of Big Complexity]]></title><description><![CDATA[Listen to founder and CEO Nick Schrock talk about how Dagster helps tame the complexity and scale when working with data in this episode of the Data Engineering podcast]]></description><link>https://dagster.io/blog/podcast-data-eng-11-20-21</link><guid isPermaLink="true">https://dagster.io/blog/podcast-data-eng-11-20-21</guid><pubDate>Sat, 20 Nov 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Hello Big Complexity: Is Your Modern Data Stack Ready?]]></title><description><![CDATA[Listen to Nick Schrock discuss the evolution of data from Big Data to Big Complexity in this episode of the Mad Data podcast]]></description><link>https://dagster.io/blog/podcast-mad-data-11-17-21</link><guid isPermaLink="true">https://dagster.io/blog/podcast-mad-data-11-17-21</guid><pubDate>Wed, 17 Nov 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Why Elementl and Dagster: The Decade of Data]]></title><description><![CDATA[Announcing our $14M Series A led by Index Ventures, alongside Sequoia Capital, Slow Ventures, Coatue, Amplify Partners, OSS Capital, and others.]]></description><link>https://dagster.io/blog/decade-of-data</link><guid isPermaLink="true">https://dagster.io/blog/decade-of-data</guid><pubDate>Tue, 16 Nov 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[New in Dagster 0.13.0: Logging Improvements!]]></title><description><![CDATA[Logging without context, instance-wide handlers, capturing python logs, and more! Learn about the improvements we've made to Dagster logging since 0.12.0.]]></description><link>https://dagster.io/blog/dagster-0-13-0-logging</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-13-0-logging</guid><pubDate>Mon, 08 Nov 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.13.0: A New Foundation]]></title><description><![CDATA[We’re proud to announce 0.13.0 of Dagster with dramatic improvements to our core APIs, completely revamped UI, and renewed clarity to our mission.]]></description><link>https://dagster.io/blog/dagster-0-13-0-a-new-foundation</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-13-0-a-new-foundation</guid><pubDate>Thu, 28 Oct 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Community Memo: Moving Dagster's Core APIs Towards 1.0]]></title><description><![CDATA[Dagster commits to a stable set of production-ready APIs for building solid data platforms.]]></description><link>https://dagster.io/blog/core-apis-moving-towards-1-0</link><guid isPermaLink="true">https://dagster.io/blog/core-apis-moving-towards-1-0</guid><pubDate>Tue, 10 Aug 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.12.0: Into the Groove]]></title><description><![CDATA[In 0.12.0, we introduce pipeline failure sensors, solid-level retries, and more convenient testing APIs.]]></description><link>https://dagster.io/blog/dagster-0-12-0-into-the-groove</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-12-0-into-the-groove</guid><pubDate>Mon, 19 Jul 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Community Memo: Approachability Improvements]]></title><description><![CDATA[In the last two months, we've made a set of changes aimed at making Dagster more approachable: to smooth out its learning curve and reduce its boilerplate.]]></description><link>https://dagster.io/blog/approachability</link><guid isPermaLink="true">https://dagster.io/blog/approachability</guid><pubDate>Tue, 25 May 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Incrementally Adopting Dagster at Mapbox]]></title><description><![CDATA[At Mapbox, we've adopted Dagster without breaking compatibility with our legacy Airflow systems -- and with huge gains to developer productivity.]]></description><link>https://dagster.io/blog/incremental-adoption-mapbox</link><guid isPermaLink="true">https://dagster.io/blog/incremental-adoption-mapbox</guid><pubDate>Tue, 18 May 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Moving past Airflow: Why Dagster is the Next-generation Data Orchestrator]]></title><description><![CDATA[A comparison between Dagster and Airflow. Here we detail the differences between the two systems, and make the case for choosing Dagster.]]></description><link>https://dagster.io/blog/dagster-airflow-prev</link><guid isPermaLink="true">https://dagster.io/blog/dagster-airflow-prev</guid><pubDate>Thu, 13 May 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.11.0: Lucky Star]]></title><description><![CDATA[In 0.11.0, we introduce dynamic orchestration, a new backfill UI, and support for tracking asset lineage.]]></description><link>https://dagster.io/blog/dagster-0-11-0-lucky-star</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-11-0-lucky-star</guid><pubDate>Thu, 01 Apr 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Building Shared Spaces for Data Teams at Drizly]]></title><description><![CDATA[Our small data infrastructure team built a data platform that supports users with different skillsets, letting anyone contribute with minimal coordination.]]></description><link>https://dagster.io/blog/shared-spaces-at-drizly</link><guid isPermaLink="true">https://dagster.io/blog/shared-spaces-at-drizly</guid><pubDate>Mon, 15 Mar 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.10.0: The Edge of Glory]]></title><description><![CDATA[In 0.10.0, we introduce unique event-based scheduling capabilities, hardened deployments on Kubernetes, and new primitives for persistence.]]></description><link>https://dagster.io/blog/dagster-0-10-0-the-edge-of-glory</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-10-0-the-edge-of-glory</guid><pubDate>Tue, 19 Jan 2021 00:00:00 GMT</pubDate></item><item><title><![CDATA[Good Data at Good Eggs: Using Dagster to Manage the Data Platform]]></title><description><![CDATA[Running pipelines is only part of running a data platform. We need to manage the platform and control technical debt. Dagster is a place to do that work. Our entire operational view of the platform is consolidated in a single tool.]]></description><link>https://dagster.io/blog/good-eggs-3</link><guid isPermaLink="true">https://dagster.io/blog/good-eggs-3</guid><pubDate>Wed, 09 Dec 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Good Data at Good Eggs: Data Observability with the Asset Catalog]]></title><description><![CDATA[Dagster gives us a single "pane of glass" for data assets. Analysts can look up when a Stitch raw data ingest occurred, a dbt model ran, or a Jupyter notebook plot was posted in Slack]]></description><link>https://dagster.io/blog/good-eggs-2</link><guid isPermaLink="true">https://dagster.io/blog/good-eggs-2</guid><pubDate>Thu, 05 Nov 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster and dbt: Better Together]]></title><description><![CDATA[People sometimes ask us — should I use Dagster, or should I use dbt? We view Dagster and dbt as complementary technologies, not competing technologies.]]></description><link>https://dagster.io/blog/dagster-dbt</link><guid isPermaLink="true">https://dagster.io/blog/dagster-dbt</guid><pubDate>Thu, 29 Oct 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Good Data at Good Eggs: Data Infrastructure Correctness and Reliability]]></title><description><![CDATA[Dagster’s custom data types helped achieve correctness and reliability in our data ingest process, less downstream breakage, and faster debugging.]]></description><link>https://dagster.io/blog/good-eggs-1</link><guid isPermaLink="true">https://dagster.io/blog/good-eggs-1</guid><pubDate>Thu, 01 Oct 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Good Data at Good Eggs: Part 1 of 4]]></title><description><![CDATA[Adopting Dagster transformed our data platform team. We hope our experience is encouraging to other teams facing similar challenges and opportunities.]]></description><link>https://dagster.io/blog/good-eggs-0</link><guid isPermaLink="true">https://dagster.io/blog/good-eggs-0</guid><pubDate>Thu, 01 Oct 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Testing and Deploying PySpark Jobs with Dagster]]></title><description><![CDATA[Spark has a beautiful API but developing with it is a pain because different stages of development and deployment demand drastically different setups.]]></description><link>https://dagster.io/blog/pyspark</link><guid isPermaLink="true">https://dagster.io/blog/pyspark</guid><pubDate>Wed, 16 Sep 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Community Memo: September 2020 Update]]></title><description><![CDATA[A retrospective of our 0.9.0 release, a preview of our 0.10.0 roadmap, and Prezi's journey from a homegrown orchestration solution to Dagster.]]></description><link>https://dagster.io/blog/community-update-sept-2020</link><guid isPermaLink="true">https://dagster.io/blog/community-update-sept-2020</guid><pubDate>Tue, 15 Sep 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Great Expectations for Dagster]]></title><description><![CDATA[We’re thrilled to announce a new integration between Dagster and a fellow open-source project, Great Expectations (GX).]]></description><link>https://dagster.io/blog/great-expectations-for-dagster</link><guid isPermaLink="true">https://dagster.io/blog/great-expectations-for-dagster</guid><pubDate>Thu, 10 Sep 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Forward Thinking Leaders]]></title><description><![CDATA[Nick Schrock shares insights on how to on how to sell new tech concepts to developers.]]></description><link>https://dagster.io/blog/podcast-how-to-sell-to-developers-08-25-2020</link><guid isPermaLink="true">https://dagster.io/blog/podcast-how-to-sell-to-developers-08-25-2020</guid><pubDate>Tue, 25 Aug 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster: The Data Orchestrator]]></title><description><![CDATA[As a workflow engine, Dagster moves beyond ordering and executing data computations. It introduces a new primitive: a data-aware, typed, self-describing, logical orchestration graph.]]></description><link>https://dagster.io/blog/dagster-the-data-orchestrator</link><guid isPermaLink="true">https://dagster.io/blog/dagster-the-data-orchestrator</guid><pubDate>Tue, 11 Aug 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.7.0: Waiting To Exhale]]></title><description><![CDATA[With 0.7.0 we set out improve the Dagster experience with large, production-scale pipelines, deployable to Kubernetes.]]></description><link>https://dagster.io/blog/dagster-0-7-0-waiting-to-exhale</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-7-0-waiting-to-exhale</guid><pubDate>Wed, 26 Feb 2020 00:00:00 GMT</pubDate></item><item><title><![CDATA[Dagster 0.6.0: Impossible Princess]]></title><description><![CDATA[Dagster 0.6.0 comes “batteries-included” and pluggable options to execute, monitor, schedule, deploy, and debug your data applications.]]></description><link>https://dagster.io/blog/dagster-0-6-0-impossible-princess</link><guid isPermaLink="true">https://dagster.io/blog/dagster-0-6-0-impossible-princess</guid><pubDate>Thu, 10 Oct 2019 00:00:00 GMT</pubDate></item><item><title><![CDATA[Introducing Dagster]]></title><description><![CDATA[Elementl announces an early release of Dagster, an open-source library for building ETL processes, ML pipelines and other data applications.]]></description><link>https://dagster.io/blog/introducing-dagster</link><guid isPermaLink="true">https://dagster.io/blog/introducing-dagster</guid><pubDate>Mon, 08 Jul 2019 00:00:00 GMT</pubDate></item></channel></rss>