I'm looking for some information in regards to integration of Mulesoft CloudHub and Prometheus.
Can the Log4j appender push logs ( runtime logs) to Prometheus server? is there a need for a parser tool such as Grok?
Any advise will be appreciated.
Thank you,
Related
We are hosting Confluent Platform services(broker, zookeeper, schema-registry etc.) in Azure VMs. What is the best option to scrape metrics from these and visualize in Azure monitor or application insights?
I am thinking to scrape JMX metrics and visualize in azure monitor/app insights. Monitoring will include things like health status, message flow in topics, produce/consume rate, VM health etc.
What are some good options to implement this? Any better ideas?
PS- I only want to use Azure native services for monitoring/dashboards.
You can add java agents by exporting the environment variable KAFKA_OPTS. Through that, you can add any additional JVM monitoring
Azure docs - https://learn.microsoft.com/en-us/azure/azure-monitor/app/java-in-process-agent
I want to implement spring-integration-aws to send and receive messages with SQS. I am looking at localstack and would like to know the recommendation of the spring team.
Which tool/api should I use for local setup of spring integration flows for SQS inbound and outbound adapters?
Also, will there be examples of AWS in spring-integration-samples in future? I am looking for an example with xml config that reads the aws config from credentials and send and receive messages via outbound adapters.
Not sure what recommendation you expect from us, but I see an answer in your own question - Localstack: https://github.com/localstack/localstack.
In the project test we indeed use this tool over a docker container:
https://github.com/spring-projects/spring-integration-aws/blob/master/src/test/java/org/springframework/integration/aws/lock/DynamoDbLockRegistryTests.java#L62
We don't have such a test against SQS, but the configuration technique is similar.
I recall I heard that Testcontainers project can be used for testing AWS services locally as well: https://www.testcontainers.org/modules/localstack/
We don't have resources to write samples for this project.
I am building the pollers based on the data from the database. Mainly file pollers.
Does Spring integration provide any way to monitor the flows via the spring admin /actuator?
If yes, is there any example?
Well, need to understand what you mean with the monitor.
There is an /integrationgraph since Spring Boot 2.1 endpoint to show all the integration components in the application context as a JSON graph. You have enable it explicitly though: https://docs.spring.io/spring-boot/docs/2.1.0.RELEASE/reference/htmlsingle/#production-ready-endpoints-exposing-endpoints.
There is also an endpoint for metrics to obtain: https://docs.spring.io/spring-boot/docs/2.1.0.RELEASE/reference/htmlsingle/#production-ready-metrics-meter
I have looked at available Grafana dashboards that will visualize metrics for my spring cloud stream app but had no luck. For example my /actuator/prometheus endpoint outputs spring integration metrics of the kind. What out of the box dashboards are available for viewing these metrics?
I am using Prometheus for my Grafana data source.
Spring Integration Metrics from my /actuator/prometheus endpoint
spring_integration_send_seconds_max{exception="none",name="output",result="success",type="channel",} 0.036514698
spring_integration_send_seconds_max{exception="none",name="org.springframework.integration.file.splitter.FileSplitter#0",result="success",type="handler",} 0.04257266
spring_integration_send_seconds_max{exception="none",name="fileSourceFlow.channel#1",result="success",type="channel",} 0.042884163
spring_integration_send_seconds_max{exception="none",name="org.springframework.integration.transformer.MessageTransformingHandler#0",result="success",type="handler",} 0.044022164
spring_integration_send_seconds_max{exception="none",name="fileSourceFlow.channel#0",result="success",type="channel",} 0.044374816
Thanks for the opportunity.
I´m to configure DAS(WSO2 Data Analytics Server) in my environment but I need that appear and capture logs with the logstash.
In the DAS exist this caracteristic?
Thanks a lot.
I think what you are looking at is to publish DAS logs to Logstash. Please check this article which explains steps to setup with WSO2 ESB. You can follow the same for DAS.