I’m trying to pull pricing data from a modern e-com site, but my standard CSS selectors keep returning null. Inspected the page and realized the elements are buried inside a #shadow-root (open).
Standard Playwright scripts always struggle with this unless I write crazy workarounds. How does RTILA handle Web Components?
Hey @scrapeninja! Shadow DOMs are notoriously frustrating because standard DOM APIs like document.querySelectorAll intentionally cannot pierce the shadow boundary.
You don’t need to write any workarounds in RTILA X though. Our extraction engine has a built-in recursive shadow-piercing function. When you pass a standard CSS selector, the engine automatically scans the main document, finds every element with a shadowRoot, and recursively queries inside them. It flattens the results so you get your data exactly as if it were in the regular DOM. Just use your normal CSS selectors and let the engine do the heavy lifting.