Reuse functions and parameters in Pipeline Builder
Palantir Developers

Reuse functions and parameters in Pipeline Builder

Reuse logic across a data pipeline via parameters and custom functions in Pipeline Builder.

Overview

In this example, you’ll learn how to reuse transformation logic in Foundry’s Pipeline Builder application using parameters and custom functions. Parameters are global values that can be used in multiple transforms in a pipeline. Updating a parameter value can modify many transforms at once. Custom functions enable you to save an expression or a series of transforms as a single transform for reuse across your pipeline. You can use parameters and custom functions to standardize transforms and manage repeating logic across pipelines efficiently.

Example Uses

  • Pipelines with recurring operations
  • Data science & business collaboration
  • Logic standardization
  • Ontology creation

Feature Highlights

  • Reusable Expressions: Simplify alterations and enhance flexibility by reusing custom expressions throughout the pipeline.
  • Reusable Transforms: Streamline development with custom transformations, consisting of multiple linked expressions, for increased flexibility and reusability.
  • Reusable Parameters: Improve efficiency and consistency by changing a value once and propagating it throughout the entire pipeline.

Next Steps

  • Modify the output: Try editing the parameter Delay time threshold.
  • Create a new parameter: Use this to filter the scheduled average speed.
  • Build your own custom function: Try making your own custom function in the custom functions window.

Implementation

Pipeline
Transform raw data to produce high-quality, curated datasets that can be used in the Ontology or serve as the foundation of machine learning and analytical workflows
Pipeline Builder - Calculate Flight Data with Reusable Custom Functions
Actual results and experiences may vary. Substitute notional data with organizational data to deploy an operational workflow.