Agoora Postgresql Agent¶
This agent will scrape a postgresql database.
It will create offer-state for all tables. If enabled it will profile the tables (extract data samples and create a profile).
Configuration¶
agoora-endpoint: local.spoud.io
agoora-insecure: false
agoora-cluster: default
agoora-transport-path: /default/postgres
agoora:
scrapper:
samples-size: 500
initial-delay: PT10S
interval: PT15M
state:
enabled: true
profiling:
enabled: true
hooks:
enabled: true
transport:
agoora-path: ${agoora-transport-path}
auth:
server-url: https://${agoora-endpoint}/auth/
realm: spoud
user:
name: to-be-defined
token: to-be-defined
logistics:
endpoint: ${agoora-endpoint}
insecure: ${agoora-insecure}
hooks:
endpoint: ${agoora-endpoint}
insecure: ${agoora-insecure}
schema:
endpoint: ${agoora-endpoint}
insecure: ${agoora-insecure}
looker:
endpoint: ${agoora-endpoint}
insecure: ${agoora-insecure}
blob:
endpoint: ${agoora-endpoint}
insecure: ${agoora-insecure}
profiler:
endpoint: localhost:8089
insecure: true
quarkus:
arc:
# Needed for the grpc interceptors
remove-unused-beans: fwk
datasource:
jdbc:
url: jdbc:postgresql://127.0.0.1:5432/agoora-logistics
db-kind: postgresql
username: postgres
password: postgres
http:
port: 8280
log:
category:
"io.spoud.agoora":
level: INFO
ssl:
native: true
native:
container-build: true
additional-build-args:
- --allow-incomplete-classpath
# - --report-unsupported-elements-at-runtime
"%dev":
agoora-endpoint: local.spoud.io
agoora-insecure: true
agoora-cluster: default
agoora-transport-path: /default/postgres
agoora:
scrapper:
initial-delay: 3s
auth:
server-url: http://${agoora-endpoint}/auth/
user:
name: agoora_t_ca7cfb09-35dc-4c8a-a4c3-6be73934fd88
token: coG7jpnBBdl3eEYYmo1gONQUabwkDR5p
Minimal configuration¶
QUARKUS_DATASOURCE_JDBC_URL=jdbc:postgresql://{HOST}:{PORT}/{DATABASE}
QUARKUS_DATASOURCE_USERNAME={USERNAME}
QUARKUS_DATASOURCE_PASSWORD={PASSWORD}
AGOORA_ENDPOINT=app.agoora.com
AGOORA_AUTH_USER_NAME={AGENT_USERNAME}
AGOORA_AUTH_USER_PASSWORD={AGENT_SECRET}
AGOORA_PROFILER_ENDPOINT=localhost:8089
Enable/disable profiling¶
If you don't want the agent to look into your data you can disable the profiling by using:
AGOORA_SCRAPPER_PROFILING_ENABLED=false