Overview
Operations are transformations you apply to datasets. They’re non-destructive - your original data is always preserved, and you can add, remove, or reorder operations at any time.Operation Pipeline
Operations are applied in sequence, creating a transformation pipeline:AI Operations
Use AI
Generate AI-powered content based on other column data. Perfect for enrichment, classification, and content generation.Detect Headers
Use AI to detect column headers in messy data and rename columns automatically.Transform Operations
Filter Rows
Keep or exclude rows based on a condition expression.- Simple
- Multiple Conditions
Filter by a single condition:
| Field | Operator | Value |
|---|---|---|
| status | equals | active |
- Text: equals, not equals, contains, starts with, ends with, is empty, is not empty
- Number: equals, not equals, greater than, less than, between
- Date: equals, before, after, between, is empty
- Boolean: is true, is false
Select Columns
Keep only specified columns, discarding the rest.Rename Columns
Change column names for clarity or consistency.- Bulk rename multiple columns at once
- Formulas automatically update to use new names
Drop Column
Remove columns you don’t need.- Remove single or multiple columns
- Removing a column used in formulas will show a warning
Copy Column
Create a copy of a column with a new name.Add Literal Column
Add a new column with a constant value.Formula
Compute values using Excel-like formulas with column references.Text Operations
Trim Whitespace
Remove leading and trailing whitespace from text values.Collapse Whitespace
Replace multiple consecutive spaces with a single space.Normalize Case
Convert text to lowercase, uppercase, or title case.Strip Prefix / Suffix
Remove a specified prefix or suffix from text values.Replace Values
Find and replace text patterns within values.Snake Case Names
Convert all column names to snake_case format.Parsing Operations
Parse Number
Convert text to numeric values, handling various formats.Parse Boolean
Convert text like ‘yes’, ‘no’, ‘true’, ‘false’ to boolean values.Parse Timestamp
Parse date/time strings into standardized timestamp format.Parse Money
Extract numeric amounts from currency strings.Parse Percentage
Convert percentage strings to decimal values.Parse Quantity & Unit
Split values like ‘5 mg’ into separate quantity and unit columns.Null Handling
Empty to Null
Convert empty strings to null values.Null to Default
Replace null values with a specified default value.Coalesce Fields
Use the first non-null value from multiple columns.Merge Operations
Union
Combine rows from multiple tables into a single output.Join
Merge two tables by matching rows on common keys.- Left join (keep all left rows)
- Inner join (only matching rows)
- Full outer join (keep all rows)
Map Values
Replace values using a lookup table (e.g., codes to names).Identity Operations
Generate Unique ID
Create a unique identifier for each row (like a fingerprint for your data).Apply Corrections
Apply manual data corrections and overrides from the corrections table.Validation Operations
Require Fields
Ensure specified fields are present and not null in every row.Unique Constraint
Verify that values in specified columns are unique across all rows.Primary Key Constraint
Enforce primary key uniqueness and non-null constraints.Validate Schema
Validate data types and structure against a defined schema.Quarantine If
Quarantine rows that fail a custom formula-based validation rule.Quarantined rows are moved to a separate table for review, not deleted.
Quality Flags
Flag rows that match specific quality issues:| Operation | Flags rows where… |
|---|---|
| Flag Negative | Numeric field contains negative values |
| Flag Zero | Numeric field contains zero values |
| Flag If Less Than | One column is less than another |
| Flag Invalid Units | Units not in allowed list |
| Flag Missing Units | Quantity has no associated unit |
Operation History
Every operation is tracked in the history:- View when each operation was added
- See who made changes (in team workspaces)
- Undo/redo operations
- Reset to any point in history
Best Practices
Order matters
Order matters
Operations apply in sequence. Filter before validation to ensure you only validate relevant records.
Use descriptive names
Use descriptive names
Name your operations (e.g., “Remove inactive users”) so teammates understand the pipeline.
Preview before applying
Preview before applying
Always check the preview to verify the operation does what you expect.
Use AI for complex tasks
Use AI for complex tasks
When pattern-based operations aren’t enough, use AI operations to handle nuanced transformations.