BigQuery Mate Chrome Extension

Companion tool for google bigquery ui used by myself and my peers at Viant Inc. Adds some extra functionality to bq native ui.
Now: Finally (based on demand) decided to add bq mate for New UI - started with just cost estimation (most popular feature till now). Will see what next based on feedback and mood :o)

Previous releases:

CHANGE: pivot button moved to front (previously was available with JSON view only) - Build Pivot with Data available on current page. IMPORTANT - to cover more data (up to 500 rows) - expand result panel with + Button

NEW: Full Screen View Button

FIX: issue with "Add Fields" feature

NEW: added keyboard shortcuts to view previous/next page - Ctrl-Left, Ctrl-Right and first/last page - Ctrl-Down, Ctrl-Up (When previewing complete tables or when looking at query results)

Note: Mac users to use Alt with respective Arrows

NEW: Support for bigquery named parameters (magnus style parameters are still supported)

FIX: Parameter replacement breaks UDFs

FIX: Parameters not always replaced correctly respective sql

NEW: added switch sql version button for quick switch between Legacy and standard sql. Also ALT-L shortcut can be used for this! Double Click or SHIFT-ALT-l saves current sql version as default.

NEW & IMPROVED: Query Outline; From Context Menu or Mate toolbar

FIX: Keywords in Standard SQL Mode

FIX: Support for "Run Selected" with CTRL-E or CTRL-F5

NEW: contextual help via f1 or Right-Click Menu

FIX: Quick fix for Thousands Separator for null and empty

FIX: Quick fix for datasets filter as google yet another time changing stuff around!

NEW: Thousands Separator for numeric fields!

Features:

1. Control size of the navigation panel (retired since jan.31 2016)

2. Hide/Show Navigation Panel

3. Datasets Filtering

4. Filtered / Total Datasets Count

5. monetary cost estimation based on processed bytes

6. Keywords Auto-Capitalization

7. Comment/uncomment selection or Outside Selection

8. Support for Parametrized Query / Saved Query with Parameters

9. Tables Decoration / Manipulation

10. Find / Replace Functionality (with support for regular expressions)

11. tabs auto naming after query name (saved query)

12. Navigator: list of all bq sessions across your PC with quick info and ability to jump to

New in v1.1:

13. Query Outline

14. extended result panel

15. F5 to execute query

New in v1.2:

16. Interactive Pivots / Charts of Query Result

New in v1.4:

17. Search / Filter Recent Queries

New in v1.5:

18. Tables Filtering

19. Add All Fields to Query Editor, with or w/o alias

20. Thousands separator for numeric fields

21. Contextual Help / F1

22. Quick switch between Legacy and Standard SQL

23. save default sql version

24. Support for bigquery named paramaters (@param)

25. Keyboard Shortcuts to view previous/next and first/last page

Some Details:

1. Control size of the Datasets Panel

Datasets and tables names tend to be verbose. Allowing users to tune width of Datasets Panel is just little good to have.

2. Hide/show datasets panel

Most of your time you spend playing with Query itself. Saving your screen real estate by hiding datasets panel is another good to have

3. Datasets Filtering

Some of our Projects consist of hundreds and hundreds of datasets with tens of thousands tables in them available to users across the business. Ability to filter visible datasets helps navigate and locate needed dataset

4. Datasets Count (Filtered/Total)

Just simple counts

5. Monetary Cost estimation based on processed bytes

Estimated cost added to the validator and is based on estimated processing bytes. As well as it is based on billing tier 1 pricing ($5 per TB currently)

6. Keywords Auto-Capitalization

“Auto-capitalization as you type” is added for GBQ Keywords. It is only html decoration so copy/paste of BQL still is as originally typed and not as it is shown.

To address this – preserve format (in context menu) is introduced. After format is preserved – decoration is preserved as actual text. So you can copy paste “well-formatted” text.

7. Comment/Uncomment Selection or Outside Selection

Ctrl+/ and Shift+Ctrl+/ respectively comments and uncomments selected lines

Ctrl+Alt+/ and Shift+Ctrl+Alt+/ respectively comment and uncomment lines outside selection

8. Support for Parametrized Query / Saved Query with Parameters

If you have you saved queries stored with parameters – now you can easily bulk set those parameters using parameters button.

Note: parameters in this tool defined after another internal Viant’s bigquery centric orchestration and scheduling tool called magnus. Magnus is using following naming rule for parameters: <var_parametername>

You can adopt this naming to benefit parameters button functionality. otherwise check find / Replace Functionality

9. Tables Decoration / Manipulation

Using Decorate Button allows to enumerate all recognized (by Native UI) tables in query and present them to user for further decoration. This can be useful during dev/testing phase to minimize cost or to do fancy stuff with querying table’s specific time slice, etc.

10. Find / Replace Functionality (with support for regular expressions)

With regular expressions user can find any code fragments and replace them either individually or by replace pattern using captured matches. This is not text editor’s find/ replace - so feature somewhat limited - replace next is not supported yet. So far - either all or nothing

11. Tabs Auto naming after query name (saved query, new query)

Unfortunately all bigquery sessions are named as “Google BigQuery” which makes it hard to navigate through many opened queries and to locate needed one. Partially this is addressed by this extension’s Navigator feature.

In addition, this extension will automatically name user’s session with the name of opened saved query. This will be reflected in all respective browser’s Tabs and in Tool’s Navigator. Sessions with New Query will be named “New Query”

User also can change session name outside of this extension and it will be reflected in tool’s navigator – till when user loads new saved query or opens new query – in which case session is auto name to respectively name of saved query or “New Query”

12. Navigator: list of all BQ sessions across your PC with quick info and ability to jump to

When user has multiple bigquery sessions opened across one or multiple browser windows – this feature helps to see all of them in one place with brief info and ability to jump right to the one needed. This feature available in any bigquery sessions extension icon on the very right in the address bar

13. Query Outline

When dealing with complex and "bushy" query (especially with someone else's)

you want to have high level idea about the query. Here this mode is handy.

It strips out everything from query but main structure.

Use then CTRL+Z to get back original query

14. Extended Result Panel

If you want to play with your result and discover something just by exploring data -

this is your option. Click + Button on the left to the Query Result.

This will leave result panel ONLY in view with hundreds of rows of data available

at the same time per page. Click - Button and this will toggle view back to normal

15. F5 to execute query

Many data tools use F5 as a shortcut to execute script.

I've decided to add this in addition to Native UI's CTRL-Enter.

16. Interactive Pivots / Charts of Query Result

User can pivot / chart query result.

Currently only result available on page is "supported", so use extended result

panel to chart more data. Meantime there is an "easter egg" that allows to

pivot / chart whole result. If you will find it - please "Use it at your own risk"

as processing big volume of data on client side can crash your session.

17. Search / Filter Recent Queries

Allows to find specific query within recent ones by search term and status. make sure recent queries panel is visible and then use search tab in Mate Navigator.

18. Tables Filtering

If your dataset has long list of tables - you will love this feature!

You can filter tables in dataset browser panel that will appear when

you click on dataset in nav panel

19. Add Fields

Add All Fields to Query Editor, with or w/o alias.

quite frequently want to script all tables’ fields out to Query Editor.

This feature allows doing so and even with alias use.

Try and you will see how it works

20. Thousands separator for numeric fields

Switch use of thousands separator on and off.

click bq mate button to see respective checkbox.

Tested for US English locale

21. Contextual Help via F1 or Right-Click Menu

Using Contextual Menu: Right Cklick on Selected Keyword and use

Mate Menu Item "Help for 'keyword'"

Using F1: Select keyword or just click on it and press F1

Note: Help is sql version sensitive - help resource depends selected

sql version - legacy or standard sql

22. "Switch SQL Version" button for quick switch between Legacy and Standard SQL. Also ALT-L shortcut can be used for this!

23. Save Default SQL Version - Double Click on sql button or Shift-Alt-L

24. Support for BigQuery Named Paramaters - @param

Magnus style Parameters are still supported - <var_param>

25. Added Keyboard Shortcuts to view previous/next page - Ctrl-ArrowLeft, Ctrl-ArrowRight and first/last page - Ctrl-ArrowDown, Ctrl-ArrowUp

v1.3 - fix for 14 and 16 introduced by recent Google UI change

v1.4.34 - removed keywords capitalization within UDF Editor

v1.4.36 (1/8/2016) - fixed multiple broken (as a result of last night changes by Google Team in BQ UI) features

v1.5.41 (1/30/2016) - fixed multiple broken (as a result of last week massive changes by Google Team in BQ UI) features: resizing/hide/show; dataset filtering; param, replace, outline; search

v1.5.45 (2/6/2016) - again changes on Google side - small fixes. And added new feature - tables filtering

v1.5.49 (2/28/2016) - Add All Fields to Query Editor, with or w/o alias.

v1.5.52 (4/13/2016) - Thousands separator for numeric fields

v1.5.61 (5/29/2016) - Contextual Help

v1.5.83/84 (12/23/2016) - Light refreshing and bringing back some functionality that was recently broken by newer version of Web UI. added small perks while was there :o)

v1.5.87 (2/9/2017) - Added `Switch SQL Version` button for quick switch between Legacy and Standard SQL. Also ALT-L shortcut can be used for this!

v1.5.94 (2/10/2017 - added save current sql version as default - Double Click on `Switch SQL Version` button or SHIFT-ALT-L

v1.5.96 (5/15/2017 - FIX: Parameters not always replaced correctly respective SQL)

v1.5.98 (5/25/2017 - Support for BigQuery Named Parameters)

v1.5.102 (6/29/2017) - Keyboard Shortcuts to view previous/next and first/last page

Warning: Google Team is constantly working on improving their BigQuery UI. Sometimes this breaks features of the Tool. When this is a case, please calm down, stay tuned and check periorically for extension updates. I am trying to fix issues as soon as they are introduced and I see them!

****

BigQuery Mate adds some functionality to native bigquery ui that is found helpful in day on day activity.

How to install BigQuery Mate chrome extension in chrome Browser

You can Follow the below Step By Step procedure to install the BigQuery Mate Chrome Extension to your Chrome Web browser.

• Step 1: Go to the Chrome webstore https://chrome.google.com/webstore or download the extension BigQuery Mate Chrome Extension Download from https://pluginsaddonsextensions.com
• Step 2: Now search for the BigQuery Mate in Chrome Webstore Search and click on the search button.
• Step 3: click on the BigQuery Mate Chrome Extension Link
• Step 4: in the next page click on the Add to Chrome button to Download and Install the BigQuery Mate extension for your Chrome Web browser .