the_tensor = tf.get_variable(
                initializer=tf.constant(0, shape=[batch_size, sequence_len]), 
                name="a_name",
                dtype=tf.int32)

This assignment:

the_tensor[0][0].assign(0)

If the above error is reported,
it should:

the_tensor[0, 0].assign(0)