Questions tagged [apache-pulsar]
Apache Pulsar is an open-source distributed pub-sub messaging system
apache-pulsar
372
questions
0
votes
0
answers
9
views
Schema validation for producer using REST API does not validate schema [Apache Pulsar]
I'm having some issues with schema validation when using the REST API in Apache pulsar. When I use the python client, the data gets rejected if it does not adhere to the schema, (such as a required ...
- 13
0
votes
1
answer
33
views
Spring Pulsar Admin cannot create topic
I tried to use Spring Pulsar to create a topic on an Apache Pulsar instance in the cloud, but after implementing the connection settings, I keep getting the following error: Caused by: org.apache....
- 53
0
votes
0
answers
23
views
Pulsar Initialization in Docker Composition
I'd like to have a single docker-compose.yaml file for starting my development environment. In the Docker composition I have a Pulsar container:
version: '3.8'
services:
pulsar:
image: ...
- 1
1
vote
0
answers
14
views
Apache Pulsar Go Client created unexpected producer/consumer
I have a Go application which tests sending and receiving messages through Apache Pulsar and deploy them within the same Kubernetes cluster, as follows:
package main
import (
"context"
...
- 11
0
votes
2
answers
69
views
Opentelemetry collector throws "Failed to connect to broker" while connecting to pulsar(running as a docker container in my local PC)
What I was trying to achieve:
For my testing on trace processor I wanted to run the Opentelemetry provided demo app along with the collector as a docker container.
Also I wanted the OTEL collector to ...
0
votes
0
answers
23
views
Installing Pulsar helm chart takes forever
I am following the apache pulsar official guide to run a Pulsar cluster in Kubernetes (https://pulsar.apache.org/docs/3.3.x/getting-started-helm/). As I got into Step 1, created the secret required ...
- 11
0
votes
0
answers
12
views
Apache Pulsar to FileSink using pyflink
I'm reading from a pulsar source, doing some filtering and some transformations and then writing to files. I'm using 2 methods
Write to file using a map function - This provides files with the events ...
- 13
0
votes
0
answers
11
views
Failed to check the authorization for topic: The credential information is empty
I am using Pulsar SQL with Presto for querying. I have authorization to view a list of schemas and tables but when querying information from a table the program throws credential information is empty ...
0
votes
0
answers
19
views
How to achieve round robin user processing in Pulsar
we're migrating from BullMQ to Pulsar and wondering how to achieve this behaviour in Pulsar
Let's say each user produces 100 tasks. We want our system to work on users tasks in round robin fashion so ...
- 41
0
votes
1
answer
18
views
Producing C# Messages Asynchronously
We have started using Pulsar on our current project, and overall we're liking it.
Unfortunately, it appears that the current DotPulsar (.NET client) does not support .SendAsync() calls.
This is a HUGE ...
0
votes
0
answers
64
views
Singleton Pulsar Producer Using Python Client Not Working
I'm struggling with creating a singleton Apache Pulsar producer in a Django app. I have a Django application that needs to produce hundreds of messages every second. Instead of creating a new producer ...
- 187
0
votes
0
answers
22
views
Pulsar command-line tool to consume and then exit at end of data
For Kafka, I can run this on the command line, with a timeout:
kafka-console-consumer.sh --bootstrap-server <server> --topic <topic> --from-beginning --timeout-ms 1000
and it will consume ...
- 31.1k
0
votes
1
answer
58
views
Pulsar auto delete policy
I changed the configuration in pulsar's configuration file broker.conf to
brokerDeleteInactiveTopicsEnabled: true
brokerDeleteInactiveTopicsMode: delete_when_no_subscriptions
...
0
votes
0
answers
18
views
Processing throughput ReactiveMessageConsumer is too low when using Reactive Pulsar Client
I essentially consume a flux of messages (consumeMany(..)) from topic A, transform them, and immediately send/pipe the result to reactive sender (using sendMany(..)) on topic B. I also register the ...
0
votes
0
answers
35
views
Apache Pulsar: Consumer will not register but produces a timeout
I'm trying to set up Pulsar for a .NET 6.0 application. Pulsar is running standalone in a docker container. The docker compose file is as follows:
version: '3'
services:
pulsar:
image: ...
- 57