Filter

Filter

What it does: Keeps only the data you want by filtering out items that don’t meet your criteria.

Perfect for: Removing duplicates • Quality control • Selecting specific items • Data cleanup

How It Works

graph LR
    A[📊 All Data] --> B[🔍 Filter]
    B --> C[✅ Matching Items Only]

    style A fill:#e1f5fe
    style B fill:#e8f5e8
    style C fill:#f3e5f5

Simple process: All data → Filter checks each item → Only items that match your criteria

Common Filter Types

Keep items with specific values

{"field": "status", "equals": "active"}

Remove short content

{"field": "content.length", "greaterThan": 100}

Keep recent items

{"field": "date", "after": "2024-01-01"}

Remove duplicates

{"field": "id", "unique": true}

Real Example

Before filtering (all scraped articles):

[
  {"title": "Great Article", "content": "Long detailed content...", "author": "John"},
  {"title": "", "content": "Short", "author": ""},
  {"title": "Another Good One", "content": "More detailed content...", "author": "Jane"}
]

After filtering (only quality articles):

[
  {"title": "Great Article", "content": "Long detailed content...", "author": "John"},
  {"title": "Another Good One", "content": "More detailed content...", "author": "Jane"}
]

Filter used: Keep only articles with titles, content longer than 50 characters, and authors.

Common Use Cases

Remove low-quality content - Filter out articles that are too short or missing key information Deduplicate data - Remove duplicate entries from scraped data Select by criteria - Keep only items that match specific conditions Performance optimization - Reduce data size before expensive processing

Quick Troubleshooting

No items pass filter: Check that your criteria aren’t too strict or field names are correct Filter too slow: Simplify your conditions or process smaller batches Wrong results: Verify field names match your data structure exactly

What’s Next?

Related nodes: If • Merge • Edit Fields

Common workflows: Data Processing Patterns • Web Extraction Workflows • Quality Control Workflows

Learn more: Flow Control Basics • Multi-Step Workflows