Qubole is an Autonmous Data Platform built on Open Source Technology. Qubole makes Big Analytics on Cloud EASY.
Artificial Intelligence brings actions closer to analysis, making business processes to be Autonmous. It cuts the manual process of analysis to work directly with Actions. From drones to supply chain, flying cars to smart environments, artificial intelligence is changing every step of our lives.
Environmental impact of reducing data center Energy Usage done by Deep Mind for Google, or making roads safer with Self Driving Cars used by NVIDIA, Google or Uber, deep learning is making everyday life better.
Cameras can now see, microphones can hear and detect, text are understood in context. Languages are understood, speech can be mimcked, art can be generated. Global communications are no longer restricted by language boundaries, Google's machine translation has got human level accuracy in last 6 months.
Deep Learning is at the center of AI. With the recent discoveries in Activation Functions, cheap compute at teraflops scale with (GPUs), AI is moving into every part of our lives.
Folw the Install Guide to setup your cluster with Tensorflow and related libraries.
In this section we take a humble approach and show you how you can leverage data to use the power of DeepLearning on data stored in QDS.
This code base works with Qubole Data Service Platform. The modules are built on Zepplin Notebook which can be imported into your QDS environment.
The aim of these notebooks is to give you an introduction to the Tensorflow and Keras libraries. This repository is for sample code and to setup and get started on QDS with Zepplin Notebooks.
The github repo provides details on the samples.
tensorflow - Contains code for tensorflow
startup_scripts - These are QDS startup scripts
- Use the startup scripts to change the bootstrap that will install the needed libraries
- Start with
tensorflow/Tensorflow_Hello_World
tensorflow/Tensorflow_Hello_World_Part2
Notebooks - These are Zepplin Notebooks. You can directly import them by linking from Qubole Github link. The details on the documentation for QDS and Zepplin can be found here - QDS Zepplin
Please contact shivaji@aurius.io for the above work
There is a known issue with using matplotlib on the Zepplin Notebook. The backend used by default is "TKAgg". This needs to be changed to "agg".