Skip to content

Latest commit

 

History

History

03-kafka

Nest Logo

A progressive Node.js framework for building efficient and scalable server-side applications.

NPM Version Package License NPM Downloads CircleCI Coverage Discord Backers on Open Collective Sponsors on Open Collective Donate us Support us Follow us on Twitter

Description

Kafka consumer and procuder apps recipe for Mau.

This recipe is using a monorepo setup with multiple applications. Each application is a separate NestJS application. This isn't required, we just used it here for demonstration purposes.

This monorepo contains the following applications:

  1. Kafka producer
  2. Kafka consumer

Project setup

  1. Install necessary dependencies
$ npm install
$ npm install -g @nestjs/mau
  1. Create a new Mau project.
  2. Within that project, create two applications: Kafka producer and Kafka consumer.
  3. Create: Kafka broker.
  4. Now one by one, generate API keys for each application and run the following commands to deploy this recipe to the cloud:
$ npm run build APP_NAME
$ mau deploy APP_NAME

Environment variables

# Every Kafka broker comes with at least 2 nodes, hence the need for 2 URLs
KAFKA_BROKER_URL_1= # Kafka broker URL (1), example "b-1.name.ytderz.c6.kafka.us-east-1.amazonaws.com:9096"
KAFKA_BROKER_URL_2= # Kafka broker URL (2), example "b-2.name.ytderz.c6.kafka.us-east-1.amazonaws.com:9096"
KAFKA_BROKER_USERNAME= # Kafka broker username
KAFKA_BROKER_PASSWORD= # Kafka broker password

Compile and run the project

# development
$ npm run start

# watch mode
$ npm run start:dev

# production mode
$ npm run start:prod

Run tests

# unit tests
$ npm run test

# e2e tests
$ npm run test:e2e

# test coverage
$ npm run test:cov

Resources

Check out a few resources that may come in handy when working with NestJS:

  • Visit the NestJS Documentation to learn more about the framework.
  • For questions and support, please visit our Discord channel.
  • To dive deeper and get more hands-on experience, check out our official video courses.
  • Visualize your application graph and interact with the NestJS application in real-time using NestJS Devtools.
  • Need help with your project (part-time to full-time)? Check out our official enterprise support.
  • To stay in the loop and get updates, follow us on X and LinkedIn.
  • Looking for a job, or have a job to offer? Check out our official Jobs board.

Support

Nest is an MIT-licensed open source project. It can grow thanks to the sponsors and support by the amazing backers. If you'd like to join them, please read more here.

Stay in touch

License

Nest is MIT licensed.