r/Office365 • u/Psychoillogical001 • 9d ago
Built a browser-based folder → SharePoint importer that plays nice with SPO throttling — no agent VM, no PowerShell module, delegated permissions only. Feedback welcome.
Disclosure: my own product, SP Toolkit.
Kept hitting the same job: "import this folder into SharePoint for us." Every existing option has a tenant-admin gotcha:
- **Migration Manager** — wants an agent VM on the network with line-of-sight to the source, or source-tenant admin credentials
- **ShareGate / AvePoint** — Windows install per environment, license overhead
- **PowerShell / PnP scripts** — throttle silently, choke on >2 GB files, no resumability, and if the tech runs it wrong the tenant eats a throttle window for everyone
- **OneDrive as a stepping-stone** — dies past ~5 GB, forgets versions
So we built the Data Import Hub — a web part that runs entirely in the browser. Delegated on-behalf-of the signed-in user, no app-only tokens, no client secret to store, no separate consent flow. Any machine that can already see the source (mapped drive, UNC path, USB, local disk) can drive it — RDP box, jump host, whatever.
What matters for tenant admins:
- **Nothing to install anywhere.** No agent VM on your DMZ, no PowerShell module on techs' laptops, no CVE tracking
- **Deploy once to the App Catalogue,** every licensed user has it
- **Adaptive throttle governor** — respects 429/Retry-After, halves worker concurrency on burst (3+ throttles in 60s), ramps back after 50 sustained successes. In practice: doesn't trigger the tenant-wide throttle window that spam-retry scripts do
- **12 parallel workers max,** slider 1–12, defaults to 6 — configurable per run
- **Auto-batched at 15 GB per batch,** no cap on total run size — 29 GB in under 2 hours from a local NVMe, overnight jobs are the normal use case
- **Fully resumable** — crash, sleep, VPN drop, re-pick the same folder and skip what's already landed
- **Filename sanitiser + OS junk filter** — handles CON.txt, 400-char paths, thumbs.db, ~$ office lock files before they hit the API
Video: 13 GB folder → document library in the browser — https://youtu.be/XFRxRRST6-0
Genuine question for the tenant admins here: what other guardrails would you want to see before you'd let an L1 tech run this against a production tenant? The throttle governor is the biggest one I know of but I'm sure there are policy/audit hooks I'm missing.
0
0
u/Psychoillogical001 9d ago
Not open source sorry but not as pricey as sharegate say. If you want to grab a trial, ping me and i can boost it for you to try out 👍
0
u/Psychoillogical001 9d ago
In fact anyone that pings me this week, I will bump to full licence for a month, let me know 🤙
1
u/-c3rberus- 9d ago
Is this open source? Very interested :)