WDL 1.2.0: Enhancing Workflow Description Language for Bioinformatics – InfoQ

A monthly overview of things you need to know as an architect or aspiring architect.

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Tal Garfinkel discusses the isolation technologies that underlie WebAssembly, and the limitations of the current state-of-the-art.

In this episode, Thomas Betts talks with Shawna Martell and Dan Fike, about the Navigators program at Carta and how they are finding ways to decentralize decisions and empower individual contributors. The quality of technical decisions is improved, and decisions are reached more quickly because the people involved are close to the relevant context.

Tingyi Li discusses the AI Agent, exploring how it extends the frontiers of Generative AI applications and leads to next-level autonomy in combination with enterprise data.

In this podcast Shane Hastie, Lead Editor for Culture & Methods spoke with Neil Vass, a recent QCon speaker and engineering manager at Co-Op, about the importance of making change persistent in teams, and why change often fails to stick.

David Flanagan discusses using programming languages to describe Kubernetes resources, sharing constructs to deploy Kubernetes resources, and making Kubernetes resources testable and policy-driven.

Learn practical strategies to clarify critical development priorities. Register now.

There are only a few days to save up to 60% off with the special Summer Sale.

Level up your software skills by uncovering the emerging trends you should focus on. Register now.

Your monthly guide to all the topics, technologies and techniques that every professional needs to know about. Subscribe for free.

InfoQ Homepage
News
WDL 1.2.0: Enhancing Workflow Description Language for Bioinformatics

Jun 18, 2024

3
min read

The Workflow Description Language (WDL) team has announced the release of WDL 1.2.0, a significant update to improve workflow descriptions’ flexibility and usability in bioinformatics. This new version introduces several key features and enhancements that promise to streamline workflow management and execution, making it easier for developers and researchers to implement and manage complex bioinformatics workflows.

The Workflow Description Language (WDL) is an open standard specification for describing data processing workflows with a human-readable and writeable syntax. WDL makes defining analysis tasks straightforward, connecting them in workflows and parallelizing their execution. The language strives to be accessible and understandable to all users, including programmers, analysts, and production system operators.

One of the key improvements in WDL 1.2.0 is the introduction of the Directory type. This new type allows workflows to handle directories more effectively, enabling users to pass directories between tasks, which simplifies the management of grouped data files. Consider the following example:

Another noteworthy enhancement is the ability to declare inputs as environment variables. This feature allows tasks to access environment variables directly, making it easier to manage configuration settings and sensitive information without hardcoding them into the workflow scripts.

Additionally, WDL 1.2.0 introduces a new requirements and hints section. These sections provide a standardized way to specify the computational requirements and optional hints for workflow execution. This improvement helps optimize workflow performance and resource allocation, ensuring that tasks run efficiently across different environments. Consider the following example:

WDL 1.2.0 also brings several new and improved standard library functions. The join_paths function is now the preferred way to concatenate paths, the matches and find functions perform pattern matching on strings, the contains function checks for the existence of a value in an array, and the chunk function splits an array into equal-sized chunks. Additionally, the keys function can now get the names of members in an Object or Struct, the contains_key function checks for the existence of keys in various types, and the select_first function accepts a default value. The size function now handles all compound value inputs, and the length function accepts more types of arguments. Finally, the read_tsv function can read field names from a header row or an array of strings and return an array of objects.

The release of WDL 1.2.0 marks an important milestone in the evolution of workflow management for bioinformatics. The new features and enhancements are designed to address common challenges faced by bioinformatics researchers and developers, including the need for greater flexibility, improved documentation, and better error handling.

Regarding plans for WDL development, Patrick Magee, a member of the WDL governance and senior software developer at DNAStack, shared insights into the team’s direction. Magee stated:

For more information on WDL 1.2.0 and to access the complete documentation, refer to the official WDL website and GitHub repository.

A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers.

View an example

A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers.

View an example

June 24 – 25, 2024 | BOSTON, MAActionable insights to clarify today’s critical dev priorities.InfoQ Dev Summit Boston, is a two-day conference hosted by InfoQ, focusing on the most critical technical decisions senior software developers face today.
Deep-dive into 20+ technical talks and get transformative learnings from senior software developers navigating Generative AI, security, modern web applications, and more.Register Now