I have a database
You can connect directly to Holistics by following these instructions.
I don't have a database
If you don't have your own database/Data Warehouse, there are 2 approaches:
- Connect Directly to your production database
- Spin up a database on Google Cloud in 10 minutes, or a free small PostgreSQL database instance here in seconds.
I want to connect to Local Database
You may need to expose your database in order to allow Holistics' server connect via the Internet connection or the easiest way is using the Reverse SSH Tunnel, just follow these simple step in Setup Reverse SSH Tunnels to get it done!
To get started with Holistics, first you need to connect your database to Holistics. From Manage Tab or Data Source page, click on "Add Data Source", and fill in necessary information about your database.
For example, to Connect to PostgreSQL
0. Connection Requirements
These are the checklist of a successful connection to Holistics
- Allows Holistics to connect to your DB server: Allowing Holistics IP addresses, or Setting Up SSH Tunnel
- Create a database user for Holistics
1. Allow Holistics to connect to your DB
If your database is not accessible in the public network, either behind a firewall or private network, you need to consider:
- Allowing Holistics IP Addresses, or
- Setting Up SSH Tunneling
Allowing IP Addresses
Please consult with your SysAd, DBA to help you by allowing our IP addresses. Doing so ensures that only specific, trusted hosts can have access to your database.
You can find the 4 IP addresses to allow in your Data Source Connection Form (click New Data Source to open the form).
Amazon RDS
If your database is hosted on Amazon AWS, but not on a VPC, you can set up a security group and white-list Holistics' IP addresses. See the UI below (remember to change the IP address to Holistics IP, with /32
as the suffix). E.g:12.12.12.12/32
Setting Up SSH Tunneling
Setting up reverse tunnel is great if you want to open a dedicated connection from your bastion server to our tunnel server.
All connections from Holistics will then be through the tunnel for a more secure data transfer. All connections to your DB will look as if it originates from your bastion server.
Allow External Connections
Some databases by default don't allow external connections to connect to the DB. If that's the case please read more on how to do it here.
2. Create Holistics Database User
You can use your existing database user, however we recommend creating a new database user account to connect to Holistics.
Please read more about how to Grant Database User Permission here.
- PostgreSQL
- MySQL
- Microsoft SQL Server
- Amazon Redshift
- Amazon AWS Athena Setup
- Google BigQuery
- CitusDB
- Greenplum
- VoltDB
- PrestoDB
- Presto on Qubole (QDS)
- MongoDB (for data sync only)
- Oracle
- Pipedrive
- EnterpriseDB
Query Timeout
Sometimes your query takes a very long time to run and consumes too much resource. With this setting, you can set up time out limit to abort any query that takes more than specificed number of milliseconds.
Just open the data source setting and enter the limit time in milliseconds:
How It Works
- When your query reaches the number of milliseconds, an error will be raised, and depend on your database the message will be
- In PostgreSQL:
ERROR: canceling statement due to statement timeout
- In RedShift:
ERROR: Query cancelled on user's request
- In PostgreSQL:
- Currently, Holistics only supports this feature for PostgreSQL and RedShift.
Configure DB to Allow External Connections
Some databases by default don't allow external connections to connect to the DB. If that's the case please follow the below steps:
If you're using SSH tunneling and your bastion server is the same as your DB host, then you shouldn't need the below, since the DB connection will look like a local connection.
PostgreSQL
Open postgresql.conf
(usually in /etc/postgresql/9.x/main/
) and enable the following:
listen_addresses = '*'
Also, add the following lines to pg_hba.conf
:
# TYPE DATABASE USER ADDRESS METHOD
host all all 128.199.219.128/32 md5
host all all 188.166.254.67/32 md5
And restart your database to take effect:
sudo service postgresql restart
MySQL
Open my.conf
and comment out bind-address
line
# bind-address = 127.0.0.1
Then restart MySQL for the change to take effect
sudo /etc/init.d/mysql restart
# or
sudo service mysql restart