Minimize JS-based parsing

[ShadowBearVR]

Per #130 (comment), as much possible, we should manipulate data in Rust, and let the javascript call the WASM APIs instead of manipulating the data itself.