menu

gigantum

Community for help, feedback, and all things Gigantum

Channels
Team

Running Gigantum on-prem

December 2, 2019 at 10:19am

Running Gigantum on-prem

December 2, 2019 at 10:19am
Dear,
Going through the documentation of Gigantum I could not find a clear indication if it is possible to run Gigantum fully on-prem? With this, I mean to not use the Gigantum cloud service but host my own on a local server and collaborate locally with my coworkers through this local hosted service.
I ask this because when working with sensitive data I cannot use the Gigantum cloud services sadly. Is this being worked on? Should I keep an eye on Gigantum for this or is this not the direction the team is going?
Cheers

December 2, 2019 at 2:48pm
- Currently this is not available. As you have figured out, right now you have to sync with Gigantum.com. You can work locally (never press the "Publish" button) and then share with export/import via a zip file, but this is pretty clunky. If sharing once or twice maybe it's not a big deal, but if you want to send things back and forth it does get very cumbersome.
We are working on a simplified version of what gigantum.com provides that can be run on-prem, so definitely keep an eye out for it. If you have certain features that would be a must for you (e.g. log aggregation, a change in how auth works, something else), let us know. This type of information from as many different people working in different industries is very helpful!
  • reply
  • like

December 3, 2019 at 6:30am
- Currently this is not available. As you have figured out, right now you have to sync with Gigantum.com. You can work locally (never press the "Publish" button) and then share with export/import via a zip file, but this is pretty clunky. If sharing once or twice maybe it's not a big deal, but if you want to send things back and forth it does get very cumbersome.
We are working on a simplified version of what gigantum.com provides that can be run on-prem, so definitely keep an eye out for it. If you have certain features that would be a must for you (e.g. log aggregation, a change in how auth works, something else), let us know. This type of information from as many different people working in different industries is very helpful!
I am also interested in this ability. Regarding auth - integration with existing AAA systems (AD, LDAP, SSO) would be a requirement for deployment here. General user management and groups (rich setting for who can access and managing access ongoing) would be impactful too. Thanks!
  • reply
  • like
- Currently this is not available. As you have figured out, right now you have to sync with Gigantum.com. You can work locally (never press the "Publish" button) and then share with export/import via a zip file, but this is pretty clunky. If sharing once or twice maybe it's not a big deal, but if you want to send things back and forth it does get very cumbersome.
We are working on a simplified version of what gigantum.com provides that can be run on-prem, so definitely keep an eye out for it. If you have certain features that would be a must for you (e.g. log aggregation, a change in how auth works, something else), let us know. This type of information from as many different people working in different industries is very helpful!
Hello Dean, many thanks for your response and explanation. Sharing zip files, whilst possible, is indeed a bit clunky. I will definitely keep an eye out for Gigantum and its future developments. Authentication would ideally be controlled by e.g. LDAP or OAuth. Potentially bundeling Apache Airflow into Gigantum to orchestrate the running of scripts/notebooks could be interesting for my personal purposes.
  • reply
  • like
Thanks for the feedback! Pretty much everyone we have heard from wants to integrate or run their own auth on prem. Generalizing auth and supporting multiple remote servers at the same time is the main development task we need to finish to let us move things on prem.
Also , we've certainly been thinking about ways to run "batch" compute after you've done some exploratory analysis in Gigantum. Have you ever looked at papermill? It's another awesome open source tool by the Jupyter community that lets you parameterize and execute notebooks. Would some sort of easy-to-use managed service that lets you run notebooks in a parameterized, batched way meet your needs, or do you specifically need to integrate with airflow?
Edited
  • reply
  • like

December 9, 2019 at 6:24pm
I know a number of folks here where I work that would be SUPER excited about an on-prem version of gigantum. For now, we can make do with the existing offerings, but just tossing my +1 into this pile
Edited
  • reply
  • like