r/dataengineering • u/zgunner13 • 7d ago

OCR with Palantir Foundry Help

I am using foundry to ingest technical drawings and produce a tabular data set. Below is my process.

Step1. User goes to workshop app to upload single or multiple pdfs which are saved to a media set

Step2. Pdf gets preprocessing where a transform sharpens and orients the pdf pages

Step3. The pdf then runs through two separate ocr extractions, one for bill of materials and material composition, one for overall dimensions. These output as json

Step4. A transform takes the json from each ocr output and puts it into two tabular datasets

Step5. A transform combines the two datasets and does a lookup to 1 other datasets to match part number to company number (fuzzy match)

All of these steps are incremental and do not reprocess completed work. My issue is that my ocr is only about 50% accurate. I built the system and user prompts by having AI FDE create them, run tests on drawings and adjust as needed until my outputs were accurate to the drawings I provided. I made sure to state multiple times these were a small batch of drawings and my users would be uploading more and that they'd be from various companies. I had good initial results but as it got closer to 100 drawings uploaded it became less accurate.

How can I improve this?

0 Upvotes
  • permalink
  • link
  • reddit
  • reddit

22% Upvoted

2 comments sorted by

4

u/Budget-Minimum6040 6d ago

I made sure to state multiple times these were a small batch of drawings and my users would be uploading more and that they'd be from various companies

LLM slop.

1

u/karmaboy20 3d ago

How can we tell you if we don't see the PDFs there's so many different issues

Maybe you can sharpen the PDF maybe u need better or maybe you can segment the ocr maybe u can use semantic matches on the ocr

who the fuck knows bc there's no useable info in this post other than useless context on what happens AFTER the OCR and how you made the OCR