Table of Contents
1. Sign up for a google cloud trial
I used a test account; email@example.com to explore this for you and I collected screenshots along the way.
Navigate to https://cloud.google.com/ and sign up for all that cloud magic.
Go to https://console.cloud.google.com/bigquery?p=bigquery-public-data to test out your big query set up. BigQuery should be enabled for new projects by default.
We are going to explore the hacker_news datasets in this example. This is actually a collection of the data (comments and articles) from this Hacker News website.
Previewing the table is a handy feature for getting an idea of the structure of the data
If you wanted to find the top ranked comments for author ‘4ad’ you can run a query like the following (remove the \ characters if you are copy pasting this query):
SELECT author, id, ranking, time_ts, text, parent FROM
author = '4ad'
AND deleted IS NULL
2. Setting up Google Sheets with App Script
Create a new sheet in your drive folder, I’ve named mine BigQueryTest. Open up the tools > Script Editor:
You will see a blank script editor. Copy & paste the code from https://developers.google.com/apps-script/quickstart/custom-functions
Save, the first time you save it will ask you to name your project
Run the onOpen function. The first time you run this app script it will ask you to set up permissions
Whew, done. Now if you navigate back to your spreadsheet you should see some added menu items:
What happens when you click on the Prepare sheet… function?
Then how about the Generate step-by-step function?
You don’t need to understand google’s code to explore this. I find it’s better to learn by starting from scratch. This code gives you a guideline for what you can achieve but you will have a better understanding of how app script works by building out your own.
3. Enable App Script APIs in your google cloud project
Navigate to your google cloud console: https://console.cloud.google.com/apis/dashboard and click on enable APIs and services
search for App Script and click enable
4. Enable BigQuery APIs in your App Script
Navigate back to you App Script and go to Resources > Advanced Google settings
Enable BigQuery APIs
Delete your old app scrip code, copy and paste the first code sample from https://developers.google.com/apps-script/advanced/bigquery
Replace the XXXXX string with your project id, you get this from your google cloud console
Replace the query with
'SELECT COUNT (DISTINCT id) FROM [bigquery-public-data:hacker_news.comments]'
Save and run the runQuery function. You will also need to set up permissions again the first time you run this.
Dam. I got another error message:
I went to the suggested URL and it turned out I need to enable another API somewhere else. That makes me thing I did it in the wrong spot in step 3, maybe that step wasn’t needed?
I wait a few moments and go back to my app script. I click on “Run Query”. No error messages this time. If you go to your drive folder you should see a new sheet called “Big Query Results” with one row of data:
You can test out this result is roughly correct by running the query directly in your google cloud query editor:
Now you are all set up with your API integrations. Next lesson will be building out your own dashboard that puts this set up into practice.