I am following this guide on setting up dsbulk: https://docs.datastax.com/en/dsbulk/doc/dsbulk/dsbulkSimpleLoad.html
I'm getting confused at this part:
dsbulk load -url export.csv -k ks1 -t table1 \
-b "path/to/secure-connect-database_name.zip" \
-u database_user -p database_password -header true
Where is that secure-connect-database_name.zip or how should i generate this?
I'm not all keen on using the method above so if there would be a way to just pass all the parameters in a command, that would work better for me.
Please note that the first line is something specific to DataStax Astra. If you're loading to an Astra instance, you would find the secure connect bundle downloadable from the database dashboard in Astra console.
If you are using DS Bulk for Cassandra, DSE, or any other compatible API, you do not need to be concerned with the secure connect bundle. You should be able to pass every parameter you need on the command line, or written in a config file.
Thanks for your comment. Updated the docs, adding an Important note with info about the secure connect bundle ZIP and a related topic link. Might need to refresh your browser view to see the updates.
https://docs.datastax.com/en/dsbulk/doc/dsbulk/dsbulkSimpleLoad.html
https://docs.datastax.com/en/dsbulk/doc/dsbulk/dsbulkSimpleUnload.html
Related
I am trying to setup the Automatic Tuning for the Azure SQL Database, but I have found out the "Query Store is in read-only state"
So I plan to use the command to clear it to make it run "ALTER DATABASE [QueryStoreDB] SET QUERY_STORE CLEAR", but it got the error
Please help me, thank you.
To set the query store to read write mode use
ALTER DATABASE [QueryStoreDB]
SET QUERY_STORE (OPERATION_MODE = READ_WRITE);
But your error code 615 means that the cache is not in sync with the database, due to connection problems.
https://learn.microsoft.com/en-us/azure/azure-sql/database/troubleshoot-common-errors-issues?view=azuresql
Check that your SQL Server database is online
Tho the SQL command does not work, I found that there is a button that can help me finish the job -> Purge Query Data button at the right down corner.
I am completely new to sFTP (Secure File Transfer Protocol) Servers and would like to know how to send data to one.
Imagine I have set up an sFTP server, could someone provide me with the pseudo code (as I am not sure what specifics I'm required to give) for sending a .zip file to it using a Linux box on the command line.
Also could you provide me with the pseudo code that would be needed to extract that same data once it has been uploaded from that server.
Could I please ask that any code supplied be heavily commented (as I really want to understand this!)
Please be gentle with your comments, I am VERY new to all of this. I imagine I will have missed out something key that someone will need to no. If any additional information is required please let me know and I will of course supply it.
Thanks in advance. I really will appreciate any help/advise!
For a GUI, you need an SFTP client like FileZilla. There is a lot of them free.
Linux has a sftp command for bash.
From your client, you can use curl to upload and/or download files to/from your sftp server.
To upload a file:
curl -T /name/of/local/file/to/upload -u username:password sftp://hostname.com/directory/to/upload/file/to
To download a file:
curl -u username:password sftp://hostname.com/name/of/remote/file/to/download -o /name/of/local/directory/to/download/file/to
I'm trying to sync a database in a local CouchDB installation (v 1.3.1 on a Mac) and a database on Cloudant with master-master replication.
In my local Futon http://localhost:5984/_utils I've configured Replicator to replicate my local database to Cloudant. Everything works fine replicating from the local database to the Cloudant one, but not backwards. If data changes in the Cloudant's database those changes are not been replicated to my local database.
Local -> Cloudant = works
Cloudant -> Local = doesn't work
Is this possible to be made? Can anyone help?
Thanks!
Finally I figured out that I only needed to configure two replications from my local CouchDB.
Here are both replications:
{
"source":"https://username:pwd#username.cloudant.com/cloud_db",
"target":"http://username:pwd#localhost:5985/local_db"
}
{
"source":"http://username:pwd#localhost:5985/local_db",
"target":"https://username:pwd#username.cloudant.com/cloud_db"
}
Now, in http://localhost:5984/_utils/status.html there are two replications running.
Note that I added the username and password to the local connection too. That's because you need to be an authorized user in order to replicate design documents.
Thanks a lot Mike, your answer helped a lot!
Can you try specifying full URLs for both source and target? I think it would look like:
#create the replicator database for your local server
curl -X PUT 'http://127.0.0.1:5984/_replicator'
then upload this document:
{
"source":"https://username:pwd#username.cloudant.com/source_db",
"target":"http://127.0.0.1:5985/target_db"
}
Then you should be able to monitor that by a:
http://127.0.0.1:5984/_active_tasks
If that doesn't work for you, can you please copy/paste:
the body of the document in the _replicator database
grep the log file for anything with _replication
Also, there's a classic 'gotcha' here, that I think you need 'writer' permissions on both the source and target database. That may seem odd, but it's because the replicator is saving checkpoint documents on both the source and the target so that the next time you ask to replicate, it doesn't have to start from scratch.
Inside a PHP application I'm trying to replicate 4 DBs in and out: this is only happening with one of those replications: database's name is "people". To avoid any PHP library specific issue, I'm testing from bash running curl:
curl -H 'Content-Type: application/json' -X POST LOCAL_PATH/_replicate -d '{"source":"REMOTE_PATH/people","target":"LOCAL_PATH/people", "continuous":false}'
With this output:
{"error":"checkpoint_commit_failure","reason":"Error updating the source checkpoint document: conflict"}
I've checked this post, but it doesn't seem to be that, as we're using full paths for replication (both local and remote).
This happens most of the times, but not always.. Any idea???
CouchDB stores check points in the source database server for the last sequence id it was able to replicate. Therefore the credentials that you're using to replicate from the source server with also need write permission on the source database to write these check points.
However, this is not strictly necessary because check points are an optimization. Your docs will replicate just fine without these check points.
I am working on an integration with IBM Connections 4.0 and would like to inject a component into the business card popout that you get when hovering over contact in the Connections interface:
The component can be as simple as a link but an iWidget or OpenSocial Gadget would be great as well. Are there any integration points for the business card?
I have done some some initial research but have not turned up much outside of integrating the business card into an external app.
Extending the business card is explained here
http://infolib.lotus.com/resources/connections/4.0/doc/en_us/ic4_p4.html#c_admin_profiles_customize_biz_card_links
For posterity, am appending the steps I took to achieve this based on the answer from muenzpraeger to follow the steps at IBM Connections 4 Part 4: Customizing, Security, Performance, and Integration. Note that your paths may be different and you will need to get the correct user and password to access the wsadmin console.
$ mkdir -p /tmp/business-card-add-link
$ cd /opt/IBM/WebSphere/AppServer/profiles/Dmgr01/bin
$ ./wsadmin.sh -user USER -password PASSWORD -lang jython
wsadmin> execfile("connectionsConfig.py")
wsadmin> print AdminControl.getCell()
connectionswwCell01
wsadmin> LCConfigService.checkOutConfig("/tmp/business-card-add-link","connectionswwCell01")
Added the following to LotusConnections-config.xml that was in /tmp/business-card-add-link
<sloc:serviceReference serviceName="googleMeService"
href="http://www.google.com" enabled="true"
ssl_href="http://www.google.com" ssl_enabled="false"
person_card_service_url_pattern="/search?hl=en&q=email:{email}:userid:{userid}:uid:{uid}:displayName:{displayName}:phone:{workPhoneNumber}&btnG=Google+Search"
person_card_service_name_js_eval="'Google Me'"/>
and save the file. Back in the console:
wsadmin> LCConfigService.updateConfig("versionStamp","")
wsadmin> LCConfigService.checkInConfig()
wsadmin> synchAllNodes()
Restart Connections
The instructions from the link say to make changes to the service-location.xsd file as well but these changes were not persisting after checkin and restart. This results in an error that prevents Connections server from properly running. Looking at the log files it was complaining that the service googleMeService referenced in LotusConnections-config.xml was not in the list of services in service-location.xsd.
To get around this I just changed the service-location.xsd file in place. I found two occurences of the file using the find command:
find . | grep LotusConnections-config/service-location.xsd
I added <xsd:enumeration value="googleMeService" /> to the <xsd:simpleType name="serviceNames"> section as indicated by the linked documentation and restarted the Connections server.