Agoora Postgresql Agent

This agent will scrape a postgresql database.

It will create offer-state for all tables. If enabled it will profile the tables (extract data samples and create a profile).

Configuration

agoora-endpoint: local.spoud.io
agoora-insecure: false
agoora-cluster: default
agoora-transport-path: /default/postgres

agoora:
  scrapper:
    samples-size: 500
    initial-delay: PT10S
    interval: PT15M
    state:
      enabled: true
    profiling:
      enabled: true
    hooks:
      enabled: true
  transport:
    agoora-path: ${agoora-transport-path}
  auth:
    server-url: https://${agoora-endpoint}/auth/
    realm: spoud
    user:
      name: to-be-defined
      token: to-be-defined
  logistics:
    endpoint: ${agoora-endpoint}
    insecure: ${agoora-insecure}
  hooks:
    endpoint: ${agoora-endpoint}
    insecure: ${agoora-insecure}
  schema:
    endpoint: ${agoora-endpoint}
    insecure: ${agoora-insecure}
  looker:
    endpoint: ${agoora-endpoint}
    insecure: ${agoora-insecure}
  blob:
    endpoint: ${agoora-endpoint}
    insecure: ${agoora-insecure}
  profiler:
    endpoint: localhost:8089
    insecure: true

quarkus:
  arc:
    # Needed for the grpc interceptors
    remove-unused-beans: fwk
  datasource:
    jdbc:
      url: jdbc:postgresql://127.0.0.1:5432/agoora-logistics
    db-kind: postgresql
    username: postgres
    password: postgres
  http:
    port: 8280
  log:
    category:
      "io.spoud.agoora":
        level: INFO
  ssl:
    native: true
  native:
    container-build: true
    additional-build-args:
      - --allow-incomplete-classpath
#      - --report-unsupported-elements-at-runtime

"%dev":
  agoora-endpoint: local.spoud.io
  agoora-insecure: true
  agoora-cluster: default
  agoora-transport-path: /default/postgres
  agoora:
    scrapper:
      initial-delay: 3s
    auth:
      server-url: http://${agoora-endpoint}/auth/
      user:
        name: agoora_t_ca7cfb09-35dc-4c8a-a4c3-6be73934fd88
        token: coG7jpnBBdl3eEYYmo1gONQUabwkDR5p

Minimal configuration

QUARKUS_DATASOURCE_JDBC_URL=jdbc:postgresql://{HOST}:{PORT}/{DATABASE}
QUARKUS_DATASOURCE_USERNAME={USERNAME}
QUARKUS_DATASOURCE_PASSWORD={PASSWORD}
AGOORA_ENDPOINT=app.agoora.com
AGOORA_AUTH_USER_NAME={AGENT_USERNAME}
AGOORA_AUTH_USER_PASSWORD={AGENT_SECRET}
AGOORA_PROFILER_ENDPOINT=localhost:8089

Enable/disable profiling

If you don't want the agent to look into your data you can disable the profiling by using:

AGOORA_SCRAPPER_PROFILING_ENABLED=false

This way you can avoid that some sample data end up in the UI.