Job Description :
Role Summary Hands-on Foundry specialist who can design ontology-first data products, engineerhigh-reliability pipelines, and operationalize them into secure, observable, and reusable building blocks used by multiple applications (Workshop/Slate, AIP/Actions You’ll own the full lifecycle: from raw sources togoverned, versioned, materialized datasets wired into operational apps andAIP agents. Core Responsibilities Ontology & Data Product Design: Model Object Types, relationships, and semantics; enforce schema evolution strategies; defineauthoritative datasets with lineage and provenance. Pipelines & Materializations: Build Code Workbook transforms (SQL, PySpark/Scala), orchestrate multi-stage DAGs, tunecluster/runtime parameters, and implement incremental + snapshot patterns with backfills and recovery. Operationalization: Configure schedules,SLAs/SLOs, alerts/health checks, and data quality tests (constraints, anomaly/volume checks); implementidempotency, checkpointing, and graceful retries. Governance & Security: Apply RBAC, object-level permissions,policy tags/PII handling, and least-privilege patterns; integrate with enterprise identity; documentdata contracts. Performance Engineering: Optimize joins/partitions, caching/materialization strategies,file layout (e.g., Parquet/Delta), and shuffle minimization; instrument withruntime metrics and cost controls. Dev Productivity & SDLC: Use Git-backed code repos,branching/versioning, code reviews, unit/integration tests for transforms; templatize patterns for reuse across domains. Applications & Interfaces: Expose ontology-backed data toWorkshop/Slate apps wire Actions and AIP agents to governed datasets; publishclean APIs/feeds for downstream systems. Reliability & Incident Response: Own on-call for data products, run RCAs, create runbooks, and drive preventive engineering. Documentation & Enablement: Produce playbooks, data product specs, and runbooks; mentor engineers and analysts on Foundry best practices. Required Qualifications 7+ years in data engineering/analytics engineering with4+ years hands-on Palantir Foundry at scale. Deep expertise in Foundry Ontology, Code Workbooks, Pipelines, Materializations, Lineage/Provenance, an ject permissions. Strong SQL and PySpark/Scala in Foundry; comfort withUDFs, window functions, and partitioning/bucketing strategies. Proven operational excellence: SLAs/SLOs, alerting, data quality frameworks, backfills, rollbacks, blue/green or canary data releases. Fluency with Git, CI/CD for Foundry code repos, test automation for transforms, andenvironment promotion. Hands-on with cloud storage & compute (AWS/Azure/GCP), file formats (Parquet/Delta), andcost/perf tuning. Strong grasp of data governance (PII, masking, policy tags) andsecurity models within Foundry. Nice to Have Building Workshop/Slate UX tied to ontology objects; authoringActions and integrating AIP use cases. Streaming/event ingestion patterns (e.g., Kafka/Kinesis) materialized into curated datasets. Observability stacks (e.g., Datadog/CloudWatch/Prometheus) for pipeline telemetry;FinOps/cost governance. Experience establishing platform standards: templates, code style, testing frameworks,domain data product catalogs. Success Metrics (90–180 Days) =99.5% pipeline success rate, with documentedSLOs and active alerting. runtime/cost reduction via optimization and materialization strategy. Zero P1 data incidents and =4h MTTR with playbooks and automated remediation. 3+ reusable templates (ingestion, CDC, enrichment) adopted by partner teams. Ontology coverage for priority domains with versioned contracts and lineage. Example Work You’ll Own Stand up incremental CDC pipelines with watermarking & late-arrivals handling; backfill historical data safely. Define business-ready ontology for a domain and wire it toWorkshop apps and AIP agents that trigger Actions. Implement DQ gates (null/dup checks, distribution drift) that fail fast and auto-open incidents with context. Build promotion workflows (dev ? staging ? prod) with automated tests on transforms and compatibility checks for ontology changes. We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.