DSBulk with ScyllaDB - cassandra

I'm trying to use DSBulk to load data into ScyllaDB. I know officially DSBulk doesn't support Scylla, but I found a post of someone using it instead of cqlsh.
When I'm trying to connect, I'm always getting this error init query OPTIONS: error writing )
Has anyone ever used it with Scylla and know how to fix that?
Here's the post: http://mail-archives.apache.org/mod_mbox/cassandra-user/201903.mbox/%3CCALrZ4T1wkpyKcinfo6N_pAPXyn-gkV2FbkkM3ot8XOUAKd4cUQ#mail.gmail.com%3E

Hmm, interesting, worth to see the log on the scylla side and even to run wireshark with CQL plugin.
For upload, the spark migrator is a valid, tested option for Scylla

Related

Log all query in cassandra 3.4.4

I'm looking to log all logs in Cassandra 3.4.4 (for instance, to log if query was ok, bad, but also connection timed out or bad credentials). Thanks
Unfortunately Cassandra 3 doesn’t have a feature for that. However, there is an open source 3rd party plugin that does this.
Check out Ericsson’s Cassandra Query Logger:
https://github.com/Ericsson/ecaudit/
Basically, you download the JAR, add it to lib/, reference it in the Cassandra-env.sh, and that should do it.

how to find if tables are being read usging metadata query/logs in cassandra

We are using DSE Cassandra v4.8.9. I have a requirement where I need to find if the tables in Cassandra are being read using some metadata query or analyzing the logs.
We can definitely find from the application but for that we need to do code change, and we don't have cycles, so thought of considering the ways to get these details using features of DSE/Cassandra if that already available. Please advise.
You can obtain this information via JMX metrics - you need to look to the table metrics. You can obtain these metrics via JMX client, or use the nodetool cfstats command (it was renamed to tablestats in the later versions) - look to local read & write counts...

Cassandra PER PARTITION LIMIT not working throwing error in dev center

I am trying to run below CQL query in dev center (1.6) and seeing this error thus not allowing me to execute query. I verified DataStax documentation and I see syntax is correct. Any help please?
select * from some_table PER PARTITION LIMIT 1;
Error I see -> no viable alternative at input 'PER
If you're using DataStax Enterprise 6.x, then you need to use DataStax Studio instead of DevCenter. DSE 6 supports per partition limit without problems, it's a DevCenter that doesn't understand this syntax.
My guess is that you're using a version of Cassandra that does not support that syntax.

Access cassandra nodetool API progmatically

I need to provide similar utility functions such as is available through
nodetool tablestats
I've gone over their source code but didn't find a convenient solution to accessing it through code.
Is there a library available for this?
https://github.com/mariusae/cassandra/blob/master/src/java/org/apache/cassandra/tools/NodeProbe.java
The nodetool utility is connecting Cassandra via JMX and fetch all necessary data from corresponding beans. You can fetch necessary data from your program via JMX as well, but I wouldn't say that this is recommended way to do - it's better to setup some "standard" monitoring solution, like, Prometheus, connect it to Cassandra, and fetch data via it...

cassandra database testing with jmeter

I have installed cassandra CQL shell on my local system, I am using jmeter v3.0 for testing the queries per second(QPS) on cassandra CQL shell. I have installed "cassandra support" plugin available in "plugin manager" with jmeter.
I have created keyspace in cassandra(keyspace1), created a table(student) and added some data in CQL shell.
I have added "cassandra properties" from config elements and entered the properties in jmeter.
Here are the properties:
I have added "cassandra get" sampler.
added "view results tree" listener.
when I run it I am getting the following error:
ERROR: java.lang.RuntimeException:
org.apache.thrift.transport.TTransportException: Read a negative frame
size (-2080374784)!
I have given the "schema properties" as seen on github.
but no use. I am getting the same error.
Can anyone suggest me how to resolve this error?
ERROR: java.lang.RuntimeException:
org.apache.thrift.transport.TTransportException: Read a negative frame
size (-2080374784)!
I want to use the cassandra samplers for put, get and delete operations on the database.
It looks like the Netflix plugin you are using is somewhat deprecated because it uses the Cassandra thrift API which is deprecated (the plugin did not have a lot of recent commits in github too).
See announcements here and here
Even if you succeed in your test with this plugin, it would not be very representative of a current client use (hence load).
IMHO you should make your test with JSR223 groovy scripts (preprocessor and samplers) and use the Datastax standard java driver + CQL in your script. I did it some time ago, it works fine.
(update: documented here)
Or may be try this JMeter plugin from a Datastax guy, it seems to use CQL . I didn't tried it, but it looks fine.
HTH,
Alain

Resources