DataJoint Opens Migration Path From CWL to Provenance-Ready, AI-Centric Pipelines

New updates have been reported about DataJoint.

DataJoint has introduced native support to transform existing Common Workflow Language, or CWL, pipelines into DataJoint pipelines, giving research institutions a way to modernize their computational workflows without discarding prior CWL investments. By ingesting CWL definitions and running them on DataJoint’s schema-driven infrastructure, the company positions itself as a backbone for AI-ready research that emphasizes traceability, auditability, and operational resilience.

The new conversion layer addresses well-known CWL gaps in production environments, including the absence of native provenance tracking, limited error handling, and weak support for partial reruns when steps fail mid-execution. Once converted, each CWL step gains automatic provenance, creating a fully queryable record of inputs, outputs, and computational history while enabling granular retries, real-time state queries, and natural parallelization across clusters.

Crucially, DataJoint does more than orchestrate tasks; the system builds a structured entity database around the scientific artifacts produced at each workflow stage, such as processed samples, imaging outputs, or analytical results. This turns previously linear CWL pipelines into persistent scientific records that capture what was produced, how each asset relates to others, and how it can be reused or audited, which directly supports regulatory, compliance, and collaboration needs in pharma, genomics, and academic research.

CEO Jim Olson framed the move as foundational for credible AI in science, arguing that workflow definitions alone are insufficient without rigorous provenance, traceability, and governance. Strategically, this capability allows DataJoint to tap into the large installed base of CWL users across industry and federally funded programs, lowering migration friction, deepening its role in production research environments, and positioning the company as a key infrastructure provider for organizations seeking to scale trustworthy, AI-driven R&D.