TensorFlow™ on Databricks

Variables

• Faster computation of complex variables
• Distributed computation across multiple systems, including GPUs.
• Reduced redundency in some computations

Let’s have a look at this in action. First, a very basic python script:

x = 35
y = x + 5
print(y)

This script basically just says “create a variable x with value 35, set the value of a new variable y to that plus 5, which is currently 40, and print it out”. The value 40 will print out when you run this program. If you aren’t familiar with python, create a new text file called basic_script.py, and copy that code in. Save it on your computer and run it with:

python basic_script.py

Note that the path (i.e. basic_script.py) must reference the file, so if it is in the Code folder, you use:

python Code/basic_script.py

Also, make sure you have activated the Anaconda virtual environment. On Linux, this will make your prompt look something like:

(tensorenv)username@computername:~$

If that is working, let’s convert it to a TensorFlow equivalent.

import tensorflow as tf

x = tf.constant(35, name='x')
y = tf.Variable(x + 5, name='y')

print(y)

After running this, you’ll get quite a funny output, something like <tensorflow.python.ops.variables.Variable object at 0x7f074bfd9ef0>. This is clearly not the value 40.

The reason why, is that our program actually does something quite different to the previous one. The code here does the following:

1. Import the tensorflow module and call it tf
2. Create a constant value called x, and give it the numerical value 35
3. Create a Variable called y, and define it as being the equation x + 5
4. Print out the equation object for y

The subtle difference is that y isn’t given “the current value of x + 5” as in our previous program. Instead, it is effectively an equation that means “when this variable is computed, take the value of x (as it is then) and add 5 to it”. The computation of the value of y is never actually performed in the above program.

Let’s fix that:

import tensorflow as tf

x = tf.constant(35, name='x')
y = tf.Variable(x + 5, name='y')

model = tf.global_variables_initializer()

with tf.Session() as session:
    session.run(model)
    print(session.run(y))

We have removed the print(y) statement, and instead we have code that creates a session, and actually computes the value of y. This is quite a bit of boilerplate, but it works like this:

1. Import the tensorflow module and call it tf
2. Create a constant value called x, and give it the numerical value 35
3. Create a Variable called y, and define it as being the equation x + 5
4. Initialize the variables with tf.global_variables_initializer() (we will go into more detail on this)
5. Create a session for computing the values
6. Run the model created in 4
7. Run just the variable y and print out its current value

The step 4 above is where some magic happens. In this step, a graph is created of the dependencies between the variables. In this case, the variable y depends on the variable x, and that value is transformed by adding 5 to it. Keep in mind that this value isn’t computed until step 7, as up until then, only equations and relations are computed.

1) Constants can also be arrays. Predict what this code will do, then run it to confirm:

import tensorflow as tf


x = tf.constant([35, 40, 45], name='x')
y = tf.Variable(x + 5, name='y')


model = tf.global_variables_initializer()

with tf.Session() as session:
    session.run(model)
    print(session.run(y))

2) Generate a NumPy array of 10,000 random numbers (called x) and create a Variable storing the equation

import numpy as np
data = np.random.randint(1000, size=10000)

import tensorflow as tf


x = tf.Variable(0, name='x')

model = tf.global_variables_initializer()

with tf.Session() as session:
    session.run(model)
    for i in range(5):
        x = x + 1
        print(session.run(x))
        

import tensorflow as tf

x = tf.constant(35, name='x')
print(x)
y = tf.Variable(x + 5, name='y')

with tf.Session() as session:
    merged = tf.summary.merge_all()
    writer = tf.summary.FileWriter("/tmp/basic", session.graph)
    model =  tf.global_variables_initializer()
    session.run(model)
    print(session.run(y))