Web: https://www.reddit.com/r/MachineLearning/comments/xlje63/n_google_releases_tensorstore_for_highperformance/

Sept. 23, 2022, 1:17 a.m. | /u/That_Violinist_18

Machine Learning reddit.com

Blog post: [https://ai.googleblog.com/2022/09/tensorstore-for-high-performance.html](https://ai.googleblog.com/2022/09/tensorstore-for-high-performance.html)

GitHub: [https://github.com/google/tensorstore](https://github.com/google/tensorstore)

Documentation: [https://google.github.io/tensorstore/](https://google.github.io/tensorstore/)


Today we are introducing [TensorStore](https://github.com/google/tensorstore), an open-source C++ and Python software library designed for storage and manipulation of *n-*dimensional data that:

* Provides a uniform API for reading and writing multiple array formats, including [zarr](https://zarr.readthedocs.io/en/stable/) and [N5](https://github.com/saalfeldlab/n5).
* Natively supports [multiple storage systems](https://google.github.io/tensorstore/kvstore/index.html), including [Google Cloud Storage](https://google.github.io/tensorstore/kvstore/gcs/index.html), [local and network filesystems](https://google.github.io/tensorstore/kvstore/file/index.html), [HTTP servers](https://google.github.io/tensorstore/kvstore/http/index.html), and [in-memory storage](https://google.github.io/tensorstore/kvstore/memory/index.html).
* Supports read/writeback caching and transactions, with strong [atomicity, isolation, consistency, and durability](https://en.wikipedia.org/wiki/ACID) (ACID) guarantees.
* …

google machinelearning performance releases scalable storage

Postdoctoral Fellow: ML for autonomous materials discovery

@ Lawrence Berkeley National Lab | Berkeley, CA

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Research Engineer - VFX, Neural Compositing

@ Flawless | Los Angeles, California, United States

[Job-TB] Senior Data Engineer

@ CI&T | Brazil

Data Analytics Engineer

@ The Fork | Paris, France