Miguel Escobar Published April 23, 2018

Refreshing a Power BI Custom Connector in the Cloud

Power BIPower Query

These are GREAT news! Finally we have a way to refresh data from custom connectors on the Power BI service.

Step 1: Get a Power BI Custom Connector

The first thing that you’re going to need is to update your Custom Connector to be refreshable on the cloud or find a Custom Connector that is refreshable on the cloud already. I took the time and I’ve updated 3 of my Custom Connectors so that they’re ready to be refreshed in the cloud. These are:

In this case I’ll be using the Meetup API, but you can also try my other connectors as well.

Step 2: Get the Personal Gateway

Once you have the Custom Connector, you need to get the latest version of the Personal Data  Gateway. Download the Data Gateway from here.

image

You’ll notice that this new version has a Connectors tab and it gives you a list of all the Custom Connectors that you have in the specific folder path.

You can learn more about what is the Personal Data Gateway here.

Step 3: Publishing your Power BI Report

We have this report that was created with the Meetup API Custom Connector (full code about that custom connector here)

image

Once it’s in the service, I can navigate to the Data Source Credentials, click on Edit Credentials and add the credentials so this can be refreshed on the service:

image

Notice how it already lists your Gateway, but you also need to configure your Data Source Credentials, so click on Edit Credentials and enter your credentials in there:

image

Once you do that, you’ll get a new message on the top right about your data source being updated which means that you’re ready to refresh your file!

image

You can set up a scheduled refresh or refresh on demand as you’d normally do with any other dataset published to Power BI:

image

Conclusion

This a big step in the right direction. Custom Connectors will be taking over sooner than later. Big thanks to the whole Power Query and Data Gateway team for making this happen.

The Power BI team has also hinted for a certification process, so I can only imagine that the Office Store integration is coming soon and we’ll be able to have certified custom connectors and I’m hoping that those won’t need the Data Gateway.

image

If you’re looking for someone to help you create a Custom Connector, then get in touch with me so I can talk to you about my services in getting you a top notch custom connector.

Power BIPower Query
0 0 votes
Article Rating
Subscribe
Notify of
guest
8 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Frank Tonsen
Frank Tonsen
3 years ago

I tried your Power BI API Custom Connector in the Service. The connector works fine in PBI desktop. The personal gateway (May 2018) shows the connector, the gateway connection is online and credentials were accepted. However, updates always fail (“This service is not supported. Make sure you have installed the latest gateway version”).

I bet you tried it yourself. Is there anything else to be taken into account, that hasn’t be mentioned by Matt Masson?

Miguel Angel Escobar
Reply to  Frank Tonsen
3 years ago

Hey! even the on-demand refresh on the service fails for you? I’m using a beta version of the gateway and it works for me. Perhaps the public version has some bugs and you might need to wait for the next release of the gateway.

There are some connectors that are still not refresh-able on the service and they’re working to support those connectors. (specifically the YouTube Analytics one)

André P.
André P.
2 years ago

Hey! I’m finishing a custom data connector for the company, and i’m checking the steps to certify it in the near future. I’m having a few difficulties, can you help me?

Michael Billing
2 years ago

Hi Miguel,
I have made a couple of open sourced connectors for Facebook Ads, Instagram etc. using OAuth.
They don’t work in powerbi.com
I have compared code with your YouTube connector which works fine in powerbi.com

It looks like Google OAuth flows works fine via powerbi.com but not facebooks. Do you have any ideas?

Nate J
Nate J
2 years ago

Hello Miguel,

Do you know if Power BI online data (published) can be refreshed if the data feeding it is from a custom connector called Scout?

Thanks