diff options
| author | mjkwiatkowski <mati.rewa@gmail.com> | 2026-02-20 16:17:39 +0100 |
|---|---|---|
| committer | mjkwiatkowski <mati.rewa@gmail.com> | 2026-02-20 16:17:39 +0100 |
| commit | f5da60e4275ca1172128c3994298691e12d5e1f8 (patch) | |
| tree | 189804251bf88bf390e1c9ffb4472b7a798d7f22 /README.md | |
| parent | 2f16cb0f48eca4453e3e894b3d45a3aa09e6dcc0 (diff) | |
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 23 |
1 files changed, 12 insertions, 11 deletions
@@ -1,6 +1,8 @@ ### Dependencies Paths are hardcoded. +Be aware the project will only work with this OpenDC as there are hidden Maven dependencies. +Kafka topic should be named `postgres_topic`. Confluent local (see https://www.confluent.io/installation/): @@ -8,10 +10,9 @@ Confluent local (see https://www.confluent.io/installation/): export CONFLUENT_HOME=/opt/confluent export PATH=/opt/confluent/bin:$PATH cd /opt/confluent -kafka-storage.sh random-uuid -kafka-storage.sh format -t 2vi2WtHxQAOPyXb1Bj1Jvw -c etc/kafka/server.properties -kafka-server-start.sh etc/kafka/server.properties -kafka-server-start etc/kafka/server.properties +kafka-storage random-uuid +kafka-storage format -t 2vi2WtHxQAOPyXb1Bj1Jvw -c $CONFLUENT_HOME/etc/kafka/server.properties --standalone +kafka-server-start $CONFLUENT_HOME/etc/kafka/server.properties schema-registry-start $CONFLUENT_HOME/etc/schema-registry/schema-registry.properties connect-standalone $CONFLUENT_HOME/etc/kafka/connect-standalone.properties $CONFLUENT_HOME/share/confluent-common/connectors/sink-jdbc.properties ``` @@ -20,8 +21,8 @@ Confluent JDBC sink and source (includes Postgres connector) (see https://www.confluent.io/hub/confluentinc/kafka-connect-jdbc) Be mindful to configure the right `plugin.path` in `etc/kafka/connect-standalone.properties` ```bash -ln -s $HOME/git/opendc/resources/experiments/sink-jdbc.properties opt/confluent/share/confluent-common/connectors/sink-jdbc.properties -``` +ln -s /home/matt/git/opendc/resources/experiments/sink-jdbc.properties /opt/confluent/share/confluent-common/connectors +``` Protobuf: @@ -31,6 +32,7 @@ You need to run this each time you change `schema.proto` ```bash cd resources/experiments/ protoc --java_out=/home/matt/git/opendc/opendc-common/src/main/java/ schema.proto +curl -X DELETE http://localhost:8081/subjects/postgres-topic-value ``` Postgresql: @@ -45,11 +47,10 @@ touch .s.PGSQL.5432.lock chown -R postgres:postgres /run/postgresql ``` - Random ```bash -bin/kafka-topics.sh --bootstrap-server localhost:9092 --delete --topic postgres-topic -bin/kafka-topics.sh --create --topic postgres-topic --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1 +bin/kafka-topics.sh --bootstrap-server localhost:9092 --delete --topic postgres_topic +bin/kafka-topics.sh --create --topic postgres_topic --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1 bin/kafka-topics.sh --list --bootstrap-server localhost:9092 -bin/kafka-console-consumer.sh --bootstrap-server :9092 --topic postgres-topic --from-beginning -```
\ No newline at end of file +bin/kafka-console-consumer.sh --bootstrap-server :9092 --topic postgres_topic --from-beginning +``` |
