xref:0

{jms_repo}[Github repo,window=_blank]

Getting Started

Guides and examples

Reference

sample app

integrations

katacoda-scenarios-to-get-started-with-astra

Katacoda scenarios

get started with the drivers on {astra_db}

Check out the resources available to build a xref:0 or use xref:1. Or follow along with our xref:2 or jump in to xref:3.

And link:https://www.youtube.com/playlist?list=PL2g2h-wyI4SpWK1G3UaxXhzZc6aUFXbvL[these videos] are a great way to start!

examples

astream-code-examples

cfgPulsarColumnWritetimeTimestamp

cfgPulsarConfigTasksMax

connecting-with-theia-ide-to-astra

cfgPulsarConfigureErrorHandling

create-a-namespace

cfgPulsarDisplayingTopic

drop-a-namespace

manage-auth0

cfgPulsarMapKeyPair

cfgPulsarMapMultipleTables

pulsar-jms-quickstart-astra

astream-sinks

quickstart-helm-installs

about-keyspaces

index

cfgRefPulsarDates

cfgRefPulsarDseTable

adding-rows-in-your-table-using-graphql

adding-rows-to-your-table

apollo-federation

opsPulsarAddField

opsPulsarAddTableColumn

astra-docs

opsPulsarDeleteConnector

opsPulsarDisplayConfig

opsPulsarUpdateConfig

trbPulsarTsRecordFailsToWriteToTable

connect-with-azure-vpc-peering

connecting-to-astra-databases-using-cqlsh

connecting-to-your-database-with-the-datastax-c-driver

creating-a-table-in-your-keyspace-using-graphql

creating-a-udt-in-your-keyspace-graphql-first

creating-an-index-for-a-table-graphql

db-access-list

db-devops-access-list

db-devops-multi-region

db-glossary

db-integration-datagrip

db-integration-dbschema

deleting-columns-in-your-table

deleting-rows-in-your-table-using-graphql

dropping-schema-graphql

environment-variables

gRPC-go-client

gRPC-java-client

gRPC-node-client

gcp-sample-apps

getting-started-with-datastax-astra

go-querying

go-setup

graphql-using-schema-first

java-setup

loading-and-unloading-data-with-datastax-bulk-loader

managing-users-and-accounts

migrating-your-datastax-c-driver-to-connect-with-astra-databases

migrating-your-datastax-java-driver-to-connect-with-astra-databases

monitoring-databases

openapi_devops_ref

openapi_document_ref

parking-databases

resizing-databases

retrieving-data-graphql-first

retrieving-rows-in-your-table-using-graphql

rust-connecting

rust-processing

sample-apps

security-guidelines

streaming-data-with-the-datastax-apache-kafka-connector

tooling

user-permissions

using-aws-vpc-peering

using-storage-attached-indexing-sai

viewing-database-summary

DocAPIBlogPost

add_organization

app_token_next_steps

astra_tip

create_custom_role

create_db

data_types

docker_run_existing_cass_3x

gql-prereqs

graphql-first-directives

note_beta

note_region

prereqs

use_auth_token_rest_document

warning-classic-vpc-access-list

astream-faq

astream-golang-eg

connect-the-spark-cassandra-connector-to-astra

cfgPulsarCqlQuery

astream-python-eg

curl --location --head '{base_url}{base_api}/tenants/test-llp' \\n--header "Authorization: Bearer {bearer_token}"\n

check_tenant_exists

curl --location --request POST '{base_url}{base_api}/tenants?topic={topic_name}' \\n--header 'Content-Type: application/json' \\n--header "Authorization: Bearer {bearer_token}" \\n--data-raw '{\n    "cloudProvider": "aws",\n    "cloudRegion": "useast2",\n    "tenantName": "{tenant_name}",\n    "userEmail": "joshua@example.com"\n}'\n

create_tenant

curl --location --request GET '{base_url}{base_api}/clusters' \\n--header "Authorization: Bearer {bearer_token}"\n

get_clusters

200 OK if it exists\n404 Not Found if not exists\n

[\n    {\n        "clusterName": "astradev-aws",\n        "cloudProvider": "aws",\n        "cloudRegion": "useast2",\n        "clusterType": "cloud",\n        "webServiceUrl": "https://pulsar-aws-useast2.astra.datastax.com:8443",\n        "brokerServiceUrl": "pulsar+ssl://pulsar-aws-useast2.astra.datastax.com:6651",\n        "websocketUrl": "wss://pulsar-aws-useast2.astra.datastax.com:8001/ws/v2"\n    },\n    {\n        "clusterName": "pulsar-azure-us-west-2",\n        "cloudProvider": "azure",\n        "cloudRegion": "uswest2",\n        "clusterType": "cloud",\n        "webServiceUrl": "https://pulsar-azure-us-west-2.astra.datastax.com:8443",\n        "brokerServiceUrl": "pulsar+ssl://pulsar-azure-us-west-2.astra.datastax.com:6651",\n        "websocketUrl": "wss://pulsar-azure-us-west-2.astra.datastax.com:8001/ws/v2"\n    },\n    {\n        "clusterName": "pulsar-gke-useast4",\n        "cloudProvider": "gcp",\n        "cloudRegion": "useast4",\n        "clusterType": "cloud",\n        "webServiceUrl": "https://pulsar-gke-useast4.astra.datastax.com:8443",\n        "brokerServiceUrl": "pulsar+ssl://pulsar-gke-useast4.astra.datastax.com:6651",\n        "websocketUrl": "wss://pulsar-gke-useast4.astra.datastax.com:8001/ws/v2"\n    }\n]\n

result:\n[\n  {\n    "tenantName":"test-mine",\n    "clusterName":"astradev-aws",\n    "webServiceUrl":"https://pulsar-aws-useast2.api.astra.datastax.com",\n    "brokerServiceUrl":"pulsar+ssl://pulsar-aws-useast2.astra.datastax.com:6651",\n    "websocketUrl":"wss://pulsar-aws-useast2.astra.datastax.com:8001/ws/v2",\n    "websocketQueryParamUrl":"wss://pulsar-aws-useast2.astra.datastax.com:8964/ws/v2",\n    "pulsarToken":"eyJhbGciOiJSUzI1NiIsInR5xxxxxxkpXVCJ9.eyJzdWIiOiJjbGllbnQ7YjgzMTY2NzQtNmExMi00MDE0LWE1NmUtZjQ2OWU5MmRlNGFkOzE2MjMwOTI4OTAifQ.U6a7q0GujzjREa6fYxYjrccwrLnnXmoUdy32rdohEwMKvoBw-KvwNG-Ko2nNSCq7LgR71Zx9SzExsorO2KBIM9j1v_Lr_meBa9hRy8YU10Bsr4e5-Re6_yYLz9Ww2JxnptYqRLBOUgCUG03kzmmsiWvyaVjGGi3oD5AXQMbP_liYnfFbSxZM8ULjy0opkko-61d3MjGfj0BYSy9wIQ_qbYKFr-EhIXrUUXF_9KK4YRo8DSfnrJ3ZJ-50ePfVb-wcN1sOFFUJ7-6UzZa4p0TcbUHupFZzANJxxUPbssGAO0yO-qOu8Ka4COJJ9o58eCVQt3bjY7xuJgSYAiQ7lJfBow",\n    "plan":"free",\n    "planCode":"1",\n    "astraOrgGUID":"b8316674-6a12-5014-a56e-f469e92de4ad",\n    "cloudProvider":"aws",\n    "cloudProviderCode":"1",\n    "cloudRegion":"useast2",\n    "status":"active",\n    "jvmVersion":"JDK11",\n    "pulsarVersion":"2.7.2"\n  },\n  {\n    "tenantName":"tester",\n    "clusterName":"astradev-aws",\n    "webServiceUrl":"https://pulsar-aws-useast2.api.astra.datastax.com",\n    "brokerServiceUrl":"pulsar+ssl://pulsar-aws-useast2.astra.datastax.com:6651",\n    "websocketUrl":"wss://pulsar-aws-useast2.astra.datastax.com:8001/ws/v2",\n    "websocketQueryParamUrl":"wss://pulsar-aws-useast2.astra.datastax.com:8964/ws/v2",\n    "pulsarToken":"eyJhbGciOiJSUzI1xxxxxxR5cCI6IkpXVCJ9.eyJzdWIiOiJjbGllbnQ7YjgzMTY2NzQtNmExMi00MDE0LWE1NmUtZjQ2OWU5MmRlNGFkOzE2MjMxMDU1ODAifQ.BNLpkqSd5RojvnUxqX9vFqb7y0I8UHHteLZ13i_GdXDEHG_bkQSU06hR73XBErciFAPG1xTPyiixfeFTk-1_VGYkQuv9MNd1kOjZ4n-plUJo8oPnHAnWEowiq2Czq5BDpskcPfYQ0azrF7n3DivVtfe72UWyrIKfX8ZwdrjycXz78QaFUt6tWYHIvdr4lq5KX3IMT9t8zP2GxxFfgKoNAFcUJO4wCdGH63qXzOebEdXenmmshg5g49uD2OI4vwPB8DFtyNNXKUPTFF9FVdvBq1sjJOlmeug1MGt1Y-NNkryMKZCs2u8OwuMqercGLCUDfP3WmF5x99zYcQ60Wad7XA",\n    "plan":"free",\n    "planCode":"1",\n    "astraOrgGUID":"b8316674-6a12-5014-a56e-f469e92de4ad",\n    "cloudProvider":"aws",\n    "cloudProviderCode":"1",\n    "cloudRegion":"useast2",\n    "status":"active",\n    "jvmVersion":"JDK11",\n    "pulsarVersion":"2.7.2"\n  }\n]\n

get_tenants

#!/bin/bash\n\n# SET THE BEARER TOKEN FOR ALL OTHER COMMANDS\n\nBEARER_TOKEN=<replace_me>\n\n\n# SET VARIABLES\nbase_url=https://api.astra.datastax.com\nbase_api=/v2/streaming\ntenant_name=llp-llp-testcreater\ntenant_name_with_topics=test-llp\ntopic_name=blah\ncluster_name=astradev-aws\n\nfor FILE in *;\n do\n    if [[ "$FILE" != "test"* ]]\n    then\n      gsed "s#{base_url}#$base_url#; s#{base_api}#$base_api#; s#{tenant_name}#$tenant_name#; s#{tenant_name_with_topics}#$tenant_name_with_topics#; s#{topic_name}#$topic_name#; s#{cluster_name}#$cluster_name#; s#{bearer_token}#$BEARER_TOKEN#;" $FILE > $FILE.tmp;\n      chmod 755 $FILE.tmp;\n    fi\ndone\n\necho -e "\nGet all clusters\n"\n./get_clusters.sh.tmp | jq\n\necho -e "\nGet all providers\n"\n./get_providers.sh.tmp | jq\n\necho -e "\nGet all tenants\n"\n./get_tenants.sh.tmp | jq\n\necho -e "\nCheck tenant exists\n"\n./check_tenant_exists.sh.tmp\n\necho -e "\nCreate tenant\n"\n./create_tenant.sh.tmp | jq\n\necho -e "\nGet tenant limits\n"\n./get_tenant_limits.sh.tmp | jq\n\necho -e "\nGet all tenants again, now that new tenant is created\n"\n./get_tenants.sh.tmp | jq\n\necho -e "\nDelete tenant hard\n"\n./delete_tenant_hard.sh.tmp\n\n#echo -e "\nDelete tenant soft\n"\n#./delete_tenant_soft.sh.tmp\n\n# CLEAN UP tmp files\nrm *.tmp; \n

test

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "Astra Streaming is powered by http://pulsar.apache.org/[Apache Pulsar].To connect to your service, use the open-source client APIs provided by the Apache Pulsar project."\n                \n            },{\n                "type": "paragraph",\n                "text": "Astra Streaming is running Pulsar version 2.6.3. You should use this API version or higher."\n                \n            },{\n                "type": "paragraph",\n                "text": "**Choose the language that you would like to use:**"\n                \n            },{\n                "type": "table",\n                "head": [],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "xref:astream-code-examples.adoc[image:java-icon.png[]]"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "xref:astream-python-eg.adoc[image:python-icon.png[]]"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "xref:astream-golang-eg.adoc[image:golang-icon.png[]]"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "xref:astream-nodejs-eg.adoc[image:node-icon.png[]]"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "xref:0"\n                , "links": [{\n                "raw": "xref:astream-code-examples.adoc[Java]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-code-examples.adoc",\n                "name": "astream-code-examples",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Java"\n            }]\n            },{\n                "type": "cell",\n                "text": "xref:0"\n                , "links": [{\n                "raw": "xref:astream-python-eg.adoc[Python]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-python-eg.adoc",\n                "name": "astream-python-eg",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Python"\n            }]\n            },{\n                "type": "cell",\n                "text": "xref:0"\n                , "links": [{\n                "raw": "xref:astream-golang-eg.adoc[Golang]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-golang-eg.adoc",\n                "name": "astream-golang-eg",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Golang"\n            }]\n            },{\n                "type": "cell",\n                "text": "xref:0"\n                , "links": [{\n                "raw": "xref:astream-nodejs-eg.adoc[Node.js]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-nodejs-eg.adoc",\n                "name": "astream-nodejs-eg",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Node.js"\n            }]\n            }]\n        }],\n                "foot": []\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "The Golang client APIs are distributed through https://pkg.go.dev/[Golang Package Dependency].On Linux and MacOS, the Golang version 1.12 and above are supported.You can find the documentation for the Golang client https://github.com/apache/pulsar-client-go[here]."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the code examples, you'll need to make the following substitutions:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*<service-url>*: The Pulsar Broker Service URL from the Astra Streaming Console *Connect* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<streaming-token>*: Your access token from the Astra Streaming Console *Connect* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<topic-url>*: A topic URL of your choice from the Astra Streaming Console *Topics* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<subscription-name>*: A subscription name of your choice, or one that you've configured in the *Details* tab of an existing topic.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "example",\n                "content": [\n                    {\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "go get",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "To do a native install using go get:"\n                \n            },{\n                "type": "listing",\n                "content": "go get -u github.com/apache/pulsar-client-go"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Producer",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a producer on a topic, sends 3 messages synchronously and 3 messages asynchronously."\n                \n            },{\n                "type": "listing",\n                "content": "package mainimport (\t\"context\"\t\"fmt\"\t\"log\"\t\"github.com/apache/pulsar-client-go/pulsar\")func main() {    fmt.Println(\"Pulsar Producer\")    // Configuration variables pertaining to this consumer    tokenStr := \"&lt;streaming-token&gt;\"    uri := \"&lt;service-url&gt;\"    // RHEL CentOS:    trustStore := \"/etc/ssl/certs/ca-bundle.crt\"    // Debian Ubuntu:    // trustStore := '/etc/ssl/certs/ca-certificates.crt'    // OSX:    // Export the default certificates to a file, then use that file:    // security find-certificate -a -p /System/Library/Keychains/SystemCACertificates.keychain &gt; ./ca-certificates.crt    // trust_certs='./ca-certificates.crt'    topicName := \"&lt;topic-url&gt;\"\ttoken := pulsar.NewAuthenticationToken(tokenStr)\tclient, err := pulsar.NewClient(pulsar.ClientOptions{\t\tURL:                     uri,\t\tAuthentication:          token,\t\tTLSTrustCertsFilePath:   trustStore,\t})\tif err != nil {\t\tlog.Fatalf(\"Could not instantiate Pulsar client: %v\", err)\t}\tdefer client.Close()\tlog.Printf(\"creating producer...\")\t// Use the client to instantiate a producer\tproducer, err := client.CreateProducer(pulsar.ProducerOptions{\t\tTopic: topicName,\t})\tlog.Printf(\"checking error of producer creation...\")\tif err != nil {\t\tlog.Fatal(err)\t}\tdefer producer.Close()\tctx := context.Background()\t// Send 3 messages synchronously and 3 messages asynchronously\tfor i := 0; i &lt; 3; i++ {\t\t// Create a message\t\tmsg := pulsar.ProducerMessage{\t\t\tPayload: []byte(fmt.Sprintf(\"messageId-%d\", i)),\t\t}\t\t// Attempt to send the message        messageID, err := producer.Send(ctx, &amp;msg)\t\tif err != nil {\t\t\tlog.Fatal(err)\t\t}        log.Printf(\"the %s successfully published with the message ID %v\", string(msg.Payload), messageID)\t\t// Create a different message to send asynchronously\t\tasyncMsg := pulsar.ProducerMessage{\t\t\tPayload: []byte(fmt.Sprintf(\"asyncMessageId-%d\", i)),\t\t}\t\t// Attempt to send the message asynchronously and handle the response\t\tproducer.SendAsync(ctx, &amp;asyncMsg, func(msgID pulsar.MessageID, msg *pulsar.ProducerMessage, err error) {\t\t\tif err != nil {\t\t\t\tlog.Fatal(err)\t\t\t}\t\t\tlog.Printf(\"the %s successfully published with the message ID %v\", string(msg.Payload), msgID)\t\t})\t}}"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Consumer",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a consumer on a topic, waits for a message, acknowledges it in an infinite loop."\n                \n            },{\n                "type": "listing",\n                "content": "package mainimport (\t\"context\"\t\"fmt\"\t\"log\"\t\"github.com/apache/pulsar-client-go/pulsar\")func main() {    fmt.Println(\"Pulsar Consumer\")    // Configuration variables pertaining to this consumer    tokenStr := \"&lt;streaming-token&gt;\"    uri := \"pulsar+ssl://uswest2.aws.kafkaesque.io:6651\"    // RHEL CentOS:    trustStore := \"/etc/ssl/certs/ca-bundle.crt\"    // Debian Ubuntu:    // trustStore := '/etc/ssl/certs/ca-certificates.crt'    // OSX:    // Export the default certificates to a file, then use that file:    // security find-certificate -a -p /System/Library/Keychains/SystemCACertificates.keychain &gt; ./ca-certificates.crt    // trust_certs='./ca-certificates.crt'    topicName := \"&lt;topic-url&gt;\"    subscriptionName := \"&lt;subscription-name&gt;\"\ttoken := pulsar.NewAuthenticationToken(tokenStr)\t// Pulsar client\tclient, err := pulsar.NewClient(pulsar.ClientOptions{\t\tURL:                   uri,\t\tAuthentication:        token,\t\tTLSTrustCertsFilePath: trustStore,\t})\tif err != nil {\t\tlog.Fatal(err)\t}\tdefer client.Close()\tconsumer, err := client.Subscribe(pulsar.ConsumerOptions{\t\tTopic:            topicName,\t\tSubscriptionName: subscriptionName,\t})\tif err != nil {\t\tlog.Fatal(err)\t}\tdefer consumer.Close()\tctx := context.Background()\t// infinite loop to receive messages\tfor {\t\tmsg, err := consumer.Receive(ctx)\t\tif err != nil {\t\t\tlog.Fatal(err)\t\t} else {\t\t\tfmt.Println(\"Received message : \", string(msg.Payload()))\t\t}\t\tconsumer.Ack(msg)\t}}"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Reader",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a reader on a topic and reads the earliest or latest messages."\n                \n            },{\n                "type": "listing",\n                "content": "package mainimport (\t\"context\"\t\"fmt\"\t\"log\"\t\"github.com/apache/pulsar-client-go/pulsar\")func main() {    fmt.Println(\"Pulsar Reader\")    // Configuration variables pertaining to this reader    tokenStr := \"&lt;streaming-token&gt;\"    uri := \"&lt;service-url&gt;\"    // RHEL CentOS:    trustStore := \"/etc/ssl/certs/ca-bundle.crt\"    // Debian Ubuntu:    // trustStore := '/etc/ssl/certs/ca-certificates.crt'    // OSX:    // Export the default certificates to a file, then use that file:    // security find-certificate -a -p /System/Library/Keychains/SystemCACertificates.keychain &gt; ./ca-certificates.crt    // trust_certs='./ca-certificates.crt'    topicName := \"&lt;topic-url&gt;\"\ttoken := pulsar.NewAuthenticationToken(tokenStr)\t// Pulsar client\tclient, err := pulsar.NewClient(pulsar.ClientOptions{\t\tURL:                   uri,\t\tAuthentication:        token,\t\tTLSTrustCertsFilePath: trustStore,\t})\tif err != nil {\t\tlog.Fatal(err)\t}\tdefer client.Close()\treader, err := client.CreateReader(pulsar.ReaderOptions{\t\tTopic:          topicName,\t\tStartMessageID: pulsar.EarliestMessageID(),\t})\tif err != nil {\t\tlog.Fatal(err)\t}\tdefer reader.Close()\tctx := context.Background()\t// infinite loop to receive messages\tfor {\t\tmsg, err := reader.Next(ctx)\t\tif err != nil {\t\t\tlog.Fatal(err)\t\t} else {\t\t\tfmt.Println(\"Received message : \", string(msg.Payload()))\t\t}\t}}"\n                , "links": []\n            }]\n            }]\n                }]\n            }\n                ]\n            }]\n        },{\n                "type": "section",\n                "title": "Next",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:astream-quick-start.adoc[Astra Streaming QuickStart]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-quick-start.adoc",\n                "name": "astream-quick-start",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Astra Streaming QuickStart"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "Browse the xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:api.adoc[Astra API References]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "api.adoc",\n                "name": "api",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Astra API References"\n            }]\n                }]\n            }]\n            }]\n            }

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "The Java client APIs are distributed through http://search.maven.org/artifact/org.apache.pulsar/pulsar-client/2.6.3/jar[Maven Central].They require Java version 8. You can find the Javadocs https://pulsar.apache.org/api/client/[here]."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the code examples, you'll need to make the following substitutions:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*<service-url>*: The Pulsar Broker Service URL from the Astra Streaming Console *Connect* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<streaming-token>*: Your access token from the Astra Streaming Console *Connect* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<topic-url>*: A topic URL of your choice from the Astra Streaming Console *Topics* tab.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*<subscription-name>*: A subscription name of your choice, or one that you've configured in the *Details* tab of an existing topic.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "example",\n                "content": [\n                    {\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "Maven/Gradle",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "If you are using Maven in your project, add this to the `<properties>` section of your `pom.xml` file:"\n                \n            },{\n                "type": "listing",\n                "content": "&lt;pulsar.version&gt;2.6.3&lt;/pulsar.version&gt;"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "And add the following to the <dependencies> section:"\n                \n            },{\n                "type": "listing",\n                "content": "&lt;dependency&gt;  &lt;groupId&gt;org.apache.pulsar&lt;/groupId&gt;  &lt;artifactId&gt;pulsar-client&lt;/artifactId&gt;  &lt;version&gt;${pulsar.version}&lt;/version&gt;&lt;/dependency&gt;"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Producer",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a producer on a topic, sends a message, then closes the producer."\n                \n            },{\n                "type": "listing",\n                "content": "import org.apache.pulsar.client.api.*;import java.io.IOException;public class simpleProducer {    private static final String SERVICE_URL = \"&lt;service-url&gt;\";    public static void main(String[] args) throws IOException    {        // Create client object        PulsarClient client = PulsarClient.builder()                .serviceUrl(SERVICE_URL)                .authentication(                    AuthenticationFactory.token(\"&lt;streaming-token&gt;\")                )                .build();        // Create producer on a topic        Producer&lt;byte[]&gt; producer = client.newProducer()                .topic(\"&lt;topic-url&gt;\")                .create();        // Send a message to the topic        producer.send(\"Hello World\".getBytes());        //Close the producer        producer.close();        // Close the client        client.close();    }}"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Consumer",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a consumer on a topic, consumes a message, then closes the consumer."\n                \n            },{\n                "type": "listing",\n                "content": "import org.apache.pulsar.client.api.*;import java.io.IOException;import java.util.concurrent.TimeUnit;public class simpleConsumer {        private static final String SERVICE_URL = \"&lt;service-url&gt;\";        public static void main(String[] args) throws IOException        {            // Create client object            PulsarClient client = PulsarClient.builder()                    .serviceUrl(SERVICE_URL)                    .authentication(                        AuthenticationFactory.token(\"&lt;streaming-token&gt;\")                    )                    .build();            // Create consumer on a topic with a subscription            Consumer consumer = client.newConsumer()                    .topic(\"&lt;topic-url&gt;\")                    .subscriptionName(\"&lt;subscription-name&gt;\")                    .subscribe();            boolean receivedMsg = false;            // Loop until a message is received            do {                // Block for up to 1 second for a message                Message msg = consumer.receive(1, TimeUnit.SECONDS);                if(msg != null){                    System.out.printf(\"Message received: %s\", new String(msg.getData()));                    // Acknowledge the message to remove it from the message backlog                    consumer.acknowledge(msg);                    receivedMsg = true;                }            } while (!receivedMsg);            //Close the consumer            consumer.close();            // Close the client            client.close();        }}"\n                , "links": []\n            }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "Reader",\n                    "blocks": [{\n                "type": "open",\n                "content": [{\n                "type": "paragraph",\n                "text": "This sample creates a reader on a topic and reads the earliest or latest message, then closes the reader."\n                \n            },{\n                "type": "listing",\n                "content": "import org.apache.pulsar.client.api.*;import java.io.IOException;import java.util.concurrent.TimeUnit;public class simpleReader {    private static final String SERVICE_URL = \"&lt;service-url&gt;\";    public static void main(String[] args) throws IOException {        // Create client object        PulsarClient client = PulsarClient.builder()                .serviceUrl(SERVICE_URL)                .authentication(                    AuthenticationFactory.token(\"&lt;streaming-token&gt;\")                )                .build();        // Create a reader on a topic starting at the earliest retained message        // No subscription is necessary. Depending on retention policy, the        // earliest message may be days old        Reader&lt;byte[]&gt; reader = client.newReader()                .topic(\"&lt;topic-url&gt;\")                .startMessageId(MessageId.earliest)                .create();        boolean receivedMsg = false;        // Loop until a message is received        do {            // Block for up to 1 second for a message            Message msg = reader.readNext(1, TimeUnit.SECONDS);            if(msg != null){                System.out.printf(\"Message received: %s%n\",  new String(msg.getData()));                receivedMsg = true;            }        } while (!receivedMsg);        //Close the reader        reader.close();        // Close the client        client.close();    }}"\n                , "links": []\n            }]\n            }]\n                }]\n            }\n                ]\n            }]\n        },{\n                "type": "section",\n                "title": "Next",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:astream-quick-start.adoc[Astra Streaming QuickStart]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "astream-quick-start.adoc",\n                "name": "astream-quick-start",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Astra Streaming QuickStart"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "Browse the xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:api.adoc[Astra API References]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "api.adoc",\n                "name": "api",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Astra API References"\n            }]\n                }]\n            }]\n            }]\n            }

astream-java-eg

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "For information on configuring parallelism for the DataStax Apache Pulsar™ Connector, see xref:0."\n                , "links": [{\n                "raw": "xref:opsPulsarScaling.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "opsPulsarScaling.adoc",\n                "name": "opsPulsarScaling",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "OpsPulsarScaling"\n            }]\n            }]\n            }

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "The DataStax Apache Pulsar™ Connector provides an optional parameter, `ignoreErrors`.When set to `true`, it allows the connector to continue processing records even after an error occurred on the prior record."\n                \n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "ignoreErrors",\n                    "blocks": [{\n                "type": "table",\n                "head": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "Value"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Meaning"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Notes"\n                , "links": []\n            }]\n        }],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`false`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "No errors are ignored"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Deprecated - equivalent to `NONE`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`true`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Only driver errors are ignored"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Deprecated - equivalent to `DRIVER`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`NONE`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "No errors are ignored; default behavior"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": ""\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`ALL`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "All errors are ignored"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": ""\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`DRIVER`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Only driver errors are ignored"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": ""\n                , "links": []\n            }]\n        }],\n                "foot": []\n            },{\n                "type": "paragraph",\n                "text": "If you set `ignoreErrors` to any value other than `false`, any erroneous record is logged once and the next record is picked up by the Pulsar Connector automatically."\n                \n            },{\n                "type": "paragraph",\n                "text": "Default: `NONE`."\n                \n            }]\n                }]\n            }]\n            }

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "The DataStax Apache Pulsar™ Connector allows for mapping a single topic to multiple tables for a single connector instance."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the example `stocks_topic`, the key is a basic string and the value is regular JSON."\n                \n            },{\n                "type": "table",\n                "head": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "key"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "value"\n                , "links": []\n            }]\n        }],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "APPLE"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"APPL\", \"value\":208, \"exchange\":\"NASDAQ\", \"industry\":\"TECH\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "EXXON MOBIL"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"M\",\"value\":80,\"exchange\":\"NYSE\",\"industry\":\"ENERGY\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "GENERAL MOTORS"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"GM\", \"value\":38, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "AT&T"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"AT&T\",\"value\":33,\"exchange\":\"NYSE\",\"industry\":\"TELECOM\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "FORD MOTOR"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"F\", \"value\":10, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        }],\n                "foot": []\n            },{\n                "type": "paragraph",\n                "text": "In the DataStax keyspace `stocks_keyspace`, create three different tables that optimized with different schemas."\n                \n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "list_item",\n                "text": "`stocks_table_by_symbol`",\n                "content": [{\n                "type": "listing",\n                "content": "CREATE TABLE stocks_keyspace.stocks_table_by_symbol (   symbol text,   ts timestamp,   exchange text,   industry text,   name text,   value double,   PRIMARY KEY (symbol, ts));"\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "`stocks_table_by_exhange`",\n                "content": [{\n                "type": "listing",\n                "content": "CREATE TABLE stocks_keyspace.stocks_table_by_exchange (   symbol text,   ts timestamp,   exchange text,   industry text,   name text,   value double,   PRIMARY KEY (exchange, ts));"\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "`stocks_table_by_industry`",\n                "content": [{\n                "type": "listing",\n                "content": "CREATE TABLE stocks_keyspace.stocks_table_by_industry (   symbol text,   ts timestamp,   exchange text,   industry text,   name text,   value double,   PRIMARY KEY (industry, ts));"\n                , "links": []\n            }\n                ]\n            }]\n        },{\n                "type": "paragraph",\n                "text": "Configure the connector and add all the map specifications:"\n                \n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "list_item",\n                "text": "`stocks_topic` to `stocks_table_by_symbol`",\n                "content": [{\n                "type": "listing",\n                "content": "topic:   stocks_topic:      stocks_keyspace:         stocks_table_by_symbol:            mapping: 'symbol=value.symbol, ts=value.ts, exchange=value.exchange, industry=value.industry, name=key.name, value=value.value'"\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "`stocks_topic` to `stocks_table_by_exchange`",\n                "content": [{\n                "type": "listing",\n                "content": "“topic:   stocks_topic:      stocks_keyspace:         stocks_table_by_exchange:            mapping: 'symbol=value.symbol, ts=value.ts, exchange=value.exchange, industry=value.industry, name=key.name, value=value.value'"\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "`stocks_topic` to `stocks_table_by_industry`",\n                "content": [{\n                "type": "listing",\n                "content": "topic:   stocks_topic:      stocks_keyspace:         stocks_table_by_industry:            mapping: 'symbol=value.symbol, ts=value.ts, exchange=value.exchange, industry=value.industry, name=key.name, value=value.value'"\n                , "links": []\n            }\n                ]\n            }]\n        }]\n            }

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "The DataStax Apache Pulsar™ Connector processes JSON, Avro, and complex types directly into a link:0 column in the xref:0. The Pulsar message embedded field names and the UDT field names must match."\n                , "links": [{\n                "raw": "xref:index.adoc#supported-databases[supported database]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "index.adoc",\n                "name": "index",\n                "extension": "adoc",\n                "anchor": "supported-databases",\n                "text": "supported database"\n            },{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/cql/cql/cql_using/useAlterType.html[user-defined type]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/cql/cql/cql_using/useAlterType.html",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "user-defined type",\n                "rawArguments": "user-defined type"\n            }]\n            },{\n                "type": "paragraph",\n                "text": "In the example `stocks_topic`, the key is a basic string and the value is regular JSON."\n                \n            },{\n                "type": "table",\n                "head": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "key"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "value"\n                , "links": []\n            }]\n        }],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "APPLE"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"APPL\", \"value\":208, \"exchange\":\"NASDAQ\", \"industry\":\"TECH\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "EXXON MOBIL"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"M\",\"value\":80,\"exchange\":\"NYSE\",\"industry\":\"ENERGY\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "GENERAL MOTORS"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"GM\", \"value\":38, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "AT&T"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"AT&T\",\"value\":33,\"exchange\":\"NYSE\",\"industry\":\"TELECOM\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "FORD MOTOR"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"F\", \"value\":10, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"}----The DataStax keyspace name is `stocks_keyspace`. In the stocks keyspace create the user defined type, `stocks_type`:[source,language-cql]----CREATE TYPE stocks_keyspace.stocks_type (    symbol text,    ts timestamp,    exchange text,    industry text,    value double);----"\n                , "links": []\n            }]\n        }],\n                "foot": []\n            },{\n                "type": "paragraph",\n                "text": "Define a table named `stocks_udt_table` that has a column for the primitive string field `name` and a second column that uses the type, `stocks_type`:"\n                \n            },{\n                "type": "listing",\n                "content": "CREATE TABLE stocks_keyspace.stocks_table (    name text primary key,    stocks FROZEN&lt;stocks_type&gt;);"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "Configure the connector settings and use the following for the map specification:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:    stocks_topic:        stocks_keyspace:            stocks_udt_table:                mapping: 'name=key,stocks=value'"\n                , "links": []\n            }]\n            }

cfgPulsarMapUdt

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "In the Apache Pulsar™ topic mapping, you can use the ``now()``function.It returns `TIMEUUID`, which is documented in the link:0."\n                , "links": [{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/cql/cql/cql_using/refTimeUuidFunctions.html[UUID and timeuuid column]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/cql/cql/cql_using/refTimeUuidFunctions.html",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "UUID and timeuuid column",\n                "rawArguments": "UUID and timeuuid column"\n            }]\n            },{\n                "type": "paragraph",\n                "text": "For example:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:  my_topic:    my_ks:      my_table:        mapping: 'col1=now()''"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "In this example, you must create `col1` in a CQL table with the following definition:"\n                \n            },{\n                "type": "listing",\n                "content": "col1 timeuuid"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "You can use the `now()` function for mapping of multiple database columns:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:  my_topic:    my_ks:      my_table:        mapping: 'col1=now(), col2=now(), col3=now()''"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "In the example above, each occurrence of `now()` is evaluated and return a different `TIMEUUID`."\n                \n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "When the value of a record arrives to DataStax Apache Pulsar Connector instance, it could be a `DELETE`, assuming `deletesEnabled` is `true`; see xref:0."\n                , "links": [{\n                "raw": "xref:cfgRefPulsarDseTable.adoc#deletesEnabled[deletesEnabled]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "cfgRefPulsarDseTable.adoc",\n                "name": "cfgRefPulsarDseTable",\n                "extension": "adoc",\n                "anchor": "deletesEnabled",\n                "text": "deletesEnabled"\n            }]\n            },{\n                "type": "paragraph",\n                "text": "For example, consider a case where a user has mapping and used the `now()` function:"\n                \n            },{\n                "type": "listing",\n                "content": "my_pk=value.my_pk, my_value=value.my_value, loaded_at=now()"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "If there is an insertion of a value that is `null`, such as:"\n                \n            },{\n                "type": "listing",\n                "content": "\"{\\\"my_pk\\\": 1234567, \\\"my_value\\\": null}\";"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "In this scenario, the called `now()` function is ignored, and the record is deleted."\n                \n            }]\n        }]\n            }

cfgPulsarNowFunction

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "In the Apache Pulsar™ topic mapping, you can extract values from the message properties, and write the values to a xref:0."\n                , "links": [{\n                "raw": "xref:index.adoc#supported-databases[supported database table]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "index.adoc",\n                "name": "index",\n                "extension": "adoc",\n                "anchor": "supported-databases",\n                "text": "supported database table"\n            }]\n            },{\n                "type": "paragraph",\n                "text": "For example:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:  my_topic    my_keyspace:      my_table:        mapping: 'col1=key.f1, col2=value.f1, __ttl=value.f2, __timestamp=value.f3, col3=header.f4'"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "Use one or more individual mapping statements to extract the desired values and have them written to the database table."\n                \n            }]\n            }

cfgPulsarRecordHeaderToTable

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "In your DataStax Apache Pulsar™ Connector configuration file, you can directly pass settings to the DataStax Java driver by using the `datastax-java-driver` prefix.For example:"\n                \n            },{\n                "type": "listing",\n                "content": "datastax-java-driver.basic.request.consistency=ALL"\n                , "links": []\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "The following table identifies functionally equivalent DataStax Apache Pulsar Connector and DataStax Java driver settings."\n                \n            },{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            },{\n                "type": "paragraph",\n                "text": "For information about the Java properties, refer to the link:0 For information about the Pulsar Connector settings, refer to xref:0."\n                , "links": [{\n                "raw": "xref:cfgRefPulsarDseConnection.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "cfgRefPulsarDseConnection.adoc",\n                "name": "cfgRefPulsarDseConnection",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "CfgRefPulsarDseConnection"\n            },{\n                "raw": "link:https://docs.datastax.com/en/developer/java-driver-dse/2.3/manual/core/configuration/[DataStax Java driver documentation.]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/developer/java-driver-dse/2.3/manual/core/configuration/",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "DataStax Java driver documentation.",\n                "rawArguments": "DataStax Java driver documentation."\n            }]\n            },{\n                "type": "table",\n                "head": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "DataStax Apache Pulsar Connector setting"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "Using datastax-java-driver prefix"\n                , "links": []\n            }]\n        }],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`contactPoints`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.basic.contact-points`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`loadBalancing.localDc`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.basic.load-balancing-policy.local-datacenter`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`cloud.secureConnectBundle`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.basic.cloud.secure-connect-bundle`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`queryExecutionTimeout`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.basic.request.timeout`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`connectionPoolLocalSize`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.advanced.connection.pool.local.size`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`compression`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.advanced.protocol.compression`"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "`metricsHighestLatency`"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "`datastax-java-driver.advanced.metrics.session.cql-requests.highest-latency`"\n                , "links": []\n            }]\n        }],\n                "foot": []\n            },{\n                "type": "paragraph",\n                "text": "There is a difference between the Pulsar Connector's `contactPoints` setting and the Java driver's `datastax-java-driver.basic.contact-points`.For `contactPoints`, the value of the `port` is appended to every host provided by this setting.For `datastax-java-driver.basic.contact-points`, you must provide the fully qualified contact points (`host:port`)."\n                \n            },{\n                "type": "paragraph",\n                "text": "By passing in the Java driver's setting, this option gives you more configuration flexibility because you can specify a different port for each host.Example:"\n                \n            },{\n                "type": "listing",\n                "content": "datastax-java-driver.basic.contact-points = 127.0.0.1:9042, 127.0.0.2:90"\n                , "links": []\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "The following properties that are of type `List`, which you could pass into the driver from your Pulsar Connector configuration via the `datastax-java-driver` prefix, are converted by the DataStax Java driver to the `TypeSafe Config` format."\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "`datastax-java-driver.advanced.ssl-engine-factory.cipher-suites`",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`datastax-java-driver.advanced.metrics.node.enabled`",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`datastax-java-driver.advanced.metadata.schema.refreshed-keyspaces`",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`datastax-java-driver.advanced.metrics.session.enabled`",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`datastax-java-driver.basic.contact-points`",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "paragraph",\n                "text": "The conversion by the Java driver will split the comma-separated values provided in those setting to create indexed properties.For example, if you passed in `datastax-java-driver.advanced.metrics.session.enabled=a,b`, the entry is converted to:"\n                \n            },{\n                "type": "listing",\n                "content": "datastax-java-driver.advanced.metrics.session.enabled.0=adatastax-java-driver.advanced.metrics.session.enabled.1=b"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "For more information, refer to the link:0 topic."\n                , "links": [{\n                "raw": "link:https://docs.datastax.com/en/developer/java-driver/4.3/manual/core/configuration/reference/[Java driver reference configuration]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/developer/java-driver/4.3/manual/core/configuration/reference/",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "Java driver reference configuration",\n                "rawArguments": "Java driver reference configuration"\n            }]\n            }]\n        }]\n            }

cfgPulsarSettingJavaDriverConfig

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "In the Apache Pulsar™ topic mapping, you can optionally specify which column should be used as the ttl (time-to-live) of the record being inserted into the database table.The mapping setting provides a special property, `__ttl`.The format is:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:  my_topic:    my_ks:      my_table:        mapping: 'col1=key.f1, col2=value.f1, __ttl=value.f2'"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "When you specify a `ttl` value to be used while inserting the record, by mapping __ttl or .ttl static configuration, you can further specify a `timeUnit`.The default is `SECONDS`.If you want to specify a `ttl` value in a unit such as `HOURS`, set `timeUnit` to `HOURS`.DataStax Apache Pulsar Connector automatically transforms the value to `SECONDS`, which is the DSE `ttl` unit.The transformation also applies for static .ttl field configuration:"\n                \n            },{\n                "type": "listing",\n                "content": "topic:  my_topic:    my_ks:      my_table:        ttlTimeUnit: SECONDS"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "If the `ttl` is provided via mapping, such as `mapping: `__ttl=value.f2`, and by the `ttl` static configuration (`ttl: 86400`) the `ttl` value from the mapping takes precedence and is used.If you set `ttl` in both resources, DataStax Apache Pulsar™ Connector writes a warning message in the log file."\n                \n            },{\n                "type": "paragraph",\n                "text": "When you configure `ttl`, all rows for that topic table will have this same `TTL` value.DataStax Apache Pulsar™ Connector appends `AND TTL <configured-ttl-value>` to the INSERT statement for those rows."\n                \n            },{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            }]\n            }

cfgPulsarSettingRowLevelTtl

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "When the data format for the message key or value is JSON, the DataStax Apache Pulsar™ connector mapping can include individual fields in the JSON structure."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the following example, the key is text field and the value is JSON.The key is mapped to the name field and each of the JSON fields to a separate column in the table."\n                \n            },{\n                "type": "table",\n                "head": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "key"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "value"\n                , "links": []\n            }]\n        }],\n                "body": [{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "APPLE"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"APPL\", \"value\":208, \"exchange\":\"NASDAQ\", \"industry\":\"TECH\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "EXXON MOBIL"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"M\",\"value\":80,\"exchange\":\"NYSE\",\"industry\":\"ENERGY\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "GENERAL MOTORS"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"GM\", \"value\":38, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "AT&T"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"AT&T\",\"value\":33,\"exchange\":\"NYSE\",\"industry\":\"TELECOM\",\"ts\":\"2018-11-26T19:26:27.483\"}----"\n                , "links": []\n            }]\n        },{\n            "type": "row",\n            "content": [{\n                "type": "cell",\n                "text": "FORD MOTOR"\n                , "links": []\n            },{\n                "type": "cell",\n                "text": "[source,no-highlight]----{\"symbol\":\"F\", \"value\":10, \"exchange\":\"NYSE\", \"industry\":\"AUTO\", \"ts\":\"2018-11-26T19:26:27.483\"} `----"\n                , "links": []\n            }]\n        }],\n                "foot": []\n            },{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "Ensure the following when mapping fields to columns:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "Data in the Apache Pulsar™ field is compatible with the database table column link:0.",\n                    "content": []\n                    , "links": [{\n                "raw": "link:http://docs.datastax.com/en/dse/6.8/cql/cql/cql_reference/refDataTypes.html[data type]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "http://docs.datastax.com/en/dse/6.8/cql/cql/cql_reference/refDataTypes.html",\n                "protocol": "http",\n                "anchor": "",\n                "arguments": "data type",\n                "rawArguments": "data type"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "Pulsar field mapped to a database primary key (PK) column always contains data.Null values are not allowed in PK columns.",\n                    "content": [{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Set up the xref:0 table.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:index.adoc#supported-databases[supported database]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "index.adoc",\n                "name": "index",\n                "extension": "adoc",\n                "anchor": "supported-databases",\n                "text": "supported database"\n            }]\n                }, {\n                    "type": "oitem",\n                    "text": "Create the keyspace.Ensure that keyspace is replicated to a datacenter that is set in the DataStax Apache Pulsar Connector xref:0 parameter.For example, create the `stocks_keyspace`:",\n                    "content": [{\n                "type": "listing",\n                "content": "cqlsh -e \"CREATE KEYSPACE stocks_keyspace \\  WITH replication = {'class': 'NetworkTopologyStrategy',\\  'Cassandra': 1};\""\n                , "links": []\n            },{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            }]\n                    , "links": [{\n                "raw": "xref:cfgRefPulsarDseConnection.adoc#contactPoints[contactPoints]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "cfgRefPulsarDseConnection.adoc",\n                "name": "cfgRefPulsarDseConnection",\n                "extension": "adoc",\n                "anchor": "contactPoints",\n                "text": "contactPoints"\n            }]\n                }, {\n                    "type": "oitem",\n                    "text": "Create the table. For example, create the `stocks_table`:",\n                    "content": [{\n                "type": "listing",\n                "content": "cqlsh -e \"CREATE TABLE stocks_keyspace.stocks_table ( \\  symbol text, \\  ts timestamp, \\  exchange text, \\  industry text, \\  name text, \\  value double, \\  PRIMARY KEY (symbol, ts));\""\n                , "links": []\n            }]\n                    \n                }, {\n                    "type": "oitem",\n                    "text": "Verify that all nodes have the same schema version using link:0. Replace keyspace_name:",\n                    "content": [{\n                "type": "listing",\n                "content": "nodetool describering -- keyspace\\_name"\n                , "links": []\n            }]\n                    , "links": [{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/tools/nodetool/toolsDescribeRing.html[nodetool describering]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/tools/nodetool/toolsDescribeRing.html",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "nodetool describering",\n                "rawArguments": "nodetool describering"\n            }]\n                }, {\n                    "type": "oitem",\n                    "text": "In the DataStax Connector configuration file:",\n                    "content": [{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Add the topic name to `topics`.",\n                    "content": []\n                    \n                }, {\n                    "type": "oitem",\n                    "text": "Define the field-to-column mapping.",\n                    "content": [{\n                "type": "paragraph",\n                "text": "Example configurations for `stocks_topic` to `stocks_table` using the minimum required settings:"\n                \n            },{\n                "type": "listing",\n                "content": "tasks.max: 1topics: stocks_topictopic  stocks_topic:    stocks_keyspace:      stocks_table:        mapping: 'symbol=value.symbol, ts=value.ts, exchange=value.exchange, industry=value.industry, name=key, value=value.value'"\n                , "links": []\n            }]\n                    \n                }]\n            }]\n                    \n                }]\n            }]\n                    \n                }]\n            }]\n        }]\n            }

cfgPulsarStringJson

{\n                "type": "document",\n                "content": [{\n                "type": "preamble",\n                "content": [{\n                "type": "paragraph",\n                "text": "When the cluster has internal or LDAP authentication enabled, configure the user name and password settings for DataStax Apache Pulsar™ Connector.A login role for the connector with access to the mapped tables is also required."\n                \n            }]\n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "listing",\n                "content": "auth:  provider: DSE  username: login_role  password: password"\n                , "links": []\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "provider",\n                    "blocks": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "**None** - No authentication.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "**DSE** - Internal or LDAP authentication.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "**GSSAPI** - Supports SASL authentication to DSE clusters using the GSSAPI mechanism Kerberos authentication",\n                    "content": [{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            },{\n                "type": "paragraph",\n                "text": "Default: `None`"\n                \n            }]\n                    \n                }]\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "username",\n                    "blocks": [{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            }]\n                },{\n                    "type": "ditem",\n                    "text": "password",\n                    "blocks": []\n                }]\n            }]\n        }]\n            }

cfgRefPulsarAuthLdap

{\n                "type": "document",\n                "content": [{\n                "type": "preamble",\n                "content": [{\n                "type": "paragraph",\n                "text": "Configure the connection settings from Apache Pulsar™ to the cluster."\n                \n            }]\n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "listing",\n                "content": " connectionPoolLocalSize: 4 contactPoints: [dse_host_list] loadBalancing.localDc: datacenter_name port: 9042 maxConcurrentRequests: 500 maxNumberOfRecordsInBatch: 32 queryExecutionTimeout: 30 jmx: true compression: None"\n                , "links": []\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "connectionPoolLocalSize",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `4`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "contactPoints",\n                    "blocks": [{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            },{\n                "type": "paragraph",\n                "text": "Default: `localhost`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "loadBalancing.localDc",\n                    "blocks": [{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": []\n            },{\n                "type": "paragraph",\n                "text": "Default: `\"\"`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "port",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `9042`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "maxConcurrentRequests",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `500`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "maxNumberOfRecordsInBatch",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `32`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "jmx",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `true`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "compression",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `None`"\n                \n            }]\n                }]\n            },{\n                "type": "dlist",\n                "items": [{\n                    "type": "ditem",\n                    "text": "queryExecutionTimeout",\n                    "blocks": [{\n                "type": "paragraph",\n                "text": "Default: `30`"\n                \n            }]\n                }]\n            }]\n        }]\n            }

cfgRefPulsarDseConnection

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "Use the Apache Pulsar™ administration tool `sinks status` command to display the status of the DataStax Apache Pulsar™ Connector."\n                \n            },{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks status --name sink-name"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "where"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "sink-name - The sink name associated with the DataStax Apache Pulsar™ Connector.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "paragraph",\n                "text": "Example"\n                \n            },{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks status --name cass-sink-kv"\n                , "links": []\n            },{\n                "type": "listing",\n                "content": "{  \"numInstances\" : 1,  \"numRunning\" : 1,  \"instances\" : [ {    \"instanceId\" : 0,    \"status\" : {      \"running\" : true,      \"error\" : \"\",      \"numRestarts\" : 0,      \"numReadFromPulsar\" : 0,      \"numSystemExceptions\" : 0,      \"latestSystemExceptions\" : [ ],      \"numSinkExceptions\" : 0,      \"latestSinkExceptions\" : [ ],      \"numWrittenToSink\" : 0,      \"lastReceivedTime\" : 0,      \"workerId\" : \"c-standalone-fw-localhost-8080\"    }  } ]}"\n                , "links": []\n            }]\n            }

opsPulsarConnectorStatus

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "To completely remove the DataStax Apache Pulsar™ Connector:"\n                \n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "list_item",\n                "text": "Delete any sinks associated with the DataStax Apache Pulsar™ Connector:",\n                "content": [{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks delete --name sink_name --namespace sink_namespace --tenant sink_tenant"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "where"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "`name` - The name of the Pulsar sink.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`namespace` - The namespace in which the sink resides.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`sink_tenant` - The tenant name associated with the sink.",\n                    "content": [{\n                "type": "paragraph",\n                "text": "Example - delete the `cass-sink-kv`"\n                \n            },{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks delete \\    --tenant public \\    --namespace default \\    --name dse-sink-kv\"Deleted successfully\""\n                , "links": []\n            }]\n                    \n                }]\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Stop the Pulsar service:",\n                "content": [{\n                "type": "listing",\n                "content": "bin/pulsar-daemon stop standalonedoing stop standalone ...stopping standaloneShutdown is in progress... Please wait...Shutdown is in progress... Please wait...Shutdown completed."\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Remove the DataStax Apache Pulsar™ Connector from the `connectors` directory:",\n                "content": [{\n                "type": "listing",\n                "content": "rm connectors/cassandra-enhanced-pulsar-sink-1.4.0.nar"\n                , "links": []\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Restart the Pulsar service:",\n                "content": [{\n                "type": "listing",\n                "content": "bin/pulsar-daemon start standalonedoing start standalone ...starting standalone, logging to /Users/john.francis/apache-pulsar-2.7.0/logs/pulsar-standalone-jfrancis-rmbp15.logNote: Set immediateFlush to true in conf/log4j2.yaml will guarantee the logging event is flushing to disk immediately. The default behavior is switched off due to performance considerations.[AppClassLoader@18b4aac2] info AspectJ Weaver Version 1.9.2 built on Wednesday Oct 24, 2018 at 15:43:33 GMT[AppClassLoader@18b4aac2] info register classloader sun.misc.Launcher$AppClassLoader@18b4aac2[AppClassLoader@18b4aac2] info using configuration file:/Users/john.francis/apache-pulsar-2.7.0/lib/org.apache.pulsar-pulsar-zookeeper-2.7.0.jar!/META-INF/aop.xml[AppClassLoader@18b4aac2] info using configuration file:/Users/john.francis/apache-pulsar-2.7.0/lib/org.apache.pulsar-pulsar-zookeeper-utils-2.7.0.jar!/META-INF/aop.xml[AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.zookeeper.FinalRequestProcessorAspect[AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.zookeeper.ZooKeeperServerAspect[AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.broker.zookeeper.aspectj.ClientCnxnAspect"\n                , "links": []\n            }\n                ]\n            }]\n        }]\n            }

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "To restart a DataStax Apache Pulsar™ Connector that was previously running, use the `pulsar-admin sinks` command:"\n                \n            },{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks restart --name sink-name"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "where"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "sink-name - The sink name associated with the DataStax Apache Pulsar™ Connector.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "paragraph",\n                "text": "Example restart a sink"\n                \n            },{\n                "type": "paragraph",\n                "text": "To restart `dse-sink-kv`:"\n                \n            },{\n                "type": "listing",\n                "content": "bin/pulsar-admin sinks restart --name dse-sink-kvStopped successfully"\n                , "links": []\n            }]\n            }

opsPulsarRestart

{\n                "type": "document",\n                "content": [{\n                "type": "paragraph",\n                "text": "Authenticate the DataStax Apache Pulsar™ Connector session using internal or LDAP authentication.When the cluster has internal or LDAP authentication enabled, configure the user name and password settings for DataStax Apache Pulsar™ Connector.This task also requires a login role for the DataStax Apache Pulsar™ Connector with access to the mapped tables."\n                \n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "list_item",\n                "text": "Verify whether your cluster has internal or LDAP authentication enabled.Refer to the link:0 in the dse.yaml file.Authentication options for the DSE Authenticator allow you to use multiple schemes for authentication simultaneously in a DataStax Enterprise cluster.",\n                "content": [{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configDseYaml.html#configDseYaml__authenticationOptions[authentication options]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configDseYaml.html#configDseYaml__authenticationOptions",\n                "protocol": "https",\n                "anchor": "configDseYaml__authenticationOptions",\n                "arguments": "authentication options",\n                "rawArguments": "authentication options"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Additional authenticator configuration is required in dse.yaml when the authorization option in cassandra.yaml is set to `com.datastax.bdp.cassandra.auth.DseAuthorizer`.When authorization is enabled, the DataStax Apache Pulsar™ Connector login role must have a minimum of `modify` privileges on tables receiving data from the DataStax Apache Pulsar Connector.For details, refer to the link:0 options.",\n                "content": [{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configCassandra_yaml.html#configCassandra_yaml__authenticator[authorization]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configCassandra_yaml.html#configCassandra_yaml__authenticator",\n                "protocol": "https",\n                "anchor": "configCassandra_yaml__authenticator",\n                "arguments": "authorization",\n                "rawArguments": "authorization"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "In dse.yaml, there are options to configure LDAP security when the authenticator option in cassandra.yaml is set to `com.datastax.bdp.cassandra.auth.DseAuthenticator`.When not set, LDAP authentication is not used.The default in dse.yaml is that this setting is commented out (false).For details, refer to link:0.",\n                "content": [{\n                "raw": "link:https://docs.datastax.com/en/security/6.8/security/secLDAPScheme.html[Defining an LDAP scheme]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/security/6.8/security/secLDAPScheme.html",\n                "protocol": "https",\n                "anchor": "",\n                "arguments": "Defining an LDAP scheme",\n                "rawArguments": "Defining an LDAP scheme"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Internal and LDAP schemes can also be used for role management.Refer to the link:0 options.",\n                "content": [{\n                "raw": "link:https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configDseYaml.html#configDseYaml__role_management_options[role management]",\n                "type": "link",\n                "identifier": "link:0",\n                "src": "https://docs.datastax.com/en/dse/6.8/dse-admin/datastax_enterprise/config/configDseYaml.html#configDseYaml__role_management_options",\n                "protocol": "https",\n                "anchor": "configDseYaml__role_management_options",\n                "arguments": "role management",\n                "rawArguments": "role management"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "Set the relevant auth parameters in dse.yaml for `auth.provider`, `auth.username` (the login role name or LDAP username), and `auth.password`.See xref:0.",\n                "content": [{\n                "raw": "xref:cfgRefPulsarAuthLdap.adoc#ldap-parameters[parameters]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "cfgRefPulsarAuthLdap.adoc",\n                "name": "cfgRefPulsarAuthLdap",\n                "extension": "adoc",\n                "anchor": "ldap-parameters",\n                "text": "parameters"\n            }\n                ]\n            }]\n        }]\n            }

secPulsarInternalLdapAuth

{\n                "type": "document",\n                "content": [{\n                "type": "preamble",\n                "content": [{\n                "type": "paragraph",\n                "text": "The Luna Streaming Pulsar Admin Console is a web-based UI from DataStax that administers topics, namespaces, sources, sinks, and various aspects of Apache Pulsar features."\n                \n            }]\n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "In the Luna Streaming Pulsar Admin Console, you can use Pulsar clients to send and receive pub/sub messages."\n                \n            },{\n                "type": "paragraph",\n                "text": "If you haven't already, launch the Luna Streaming Pulsar Admin Console in a browser by opening the URL that was specified in the Luna Streaming Installation Console. Example:"\n                \n            },{\n                "type": "image",\n                "attributes": {\n                    "src": "Get Pulsar Admin Console URL and password from Config tab of Installation Console",\n                    "width": "undefined",\n                    "height": "undefined",\n                    "target": "luna-streaming-install-to-admin-console.png"\n                }\n            },{\n                "type": "paragraph",\n                "text": "By default, you can log in with username `admin`.  The generated and persisted password was also shown on the Config tab of the Installation Console."\n                \n            },{\n                "type": "section",\n                "title": "Pulsar Admin Console features",\n                "content": [{\n                "type": "paragraph",\n                "text": "To try out your service right now, use the built-in WebSocket test clients. See the Pulsar Admin Console's Test Clients page."\n                \n            },{\n                "type": "paragraph",\n                "text": "To see interactive code samples, go to Code Samples."\n                \n            },{\n                "type": "paragraph",\n                "text": "To see the available namespaces, go to Namespaces. Messages published to namespaces are automatically replicated to all node(s) in the cluster."\n                \n            },{\n                "type": "paragraph",\n                "text": "Topics are automatically created, by default, when you first try to publish or subscribe. To manually create a topic or to create a partitioned topic, go to Topics."\n                \n            },{\n                "type": "paragraph",\n                "text": "The first part of a full topic name is your tenant name, followed by the namespace, and then the topic name."\n                \n            },{\n                "type": "paragraph",\n                "text": "Here is an example of a topic using its full name:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`public/namespace/my-topic`"\n                \n            },{\n                "type": "paragraph",\n                "text": "You can select your current tenant using the drop-down at the top right of the Topics page. To create a new tenant, go to Tenants."\n                \n            },{\n                "type": "paragraph",\n                "text": "To see detailed information about your topics, go to Topics."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "Standalone version",\n                "content": [{\n                "type": "paragraph",\n                "text": "For information about building and running a standalone Pulsar Admin Console, see the https://github.com/datastax/pulsar-admin-console#dev[readme, window=_blank] on github.com/datastax/pulsar-admin-console."\n                \n            },{\n                "type": "paragraph",\n                "text": "When connecting you may need to provide the connect token for your account. You can get the token by going to the Pulsar Admin Console's Credentials page."\n                \n            }]\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "Go to the Pulsar Admin Console's **Test Clients** page. The quickest way to try your service is to use the test clients, sending messages from one client to the other."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the WebSocket Test Client 1 section, click **Connect**. This action creates a connection from the Pulsar Admin Console that's running in your browser to the Pulsar instance on your server."\n                \n            },{\n                "type": "paragraph",\n                "text": "Scroll down to the Consume tab. In this simple example, which verifies that the service is running properly, add a `hello world` message and click Send. Example:"\n                \n            },{\n                "type": "image",\n                "attributes": {\n                    "src": "Send a message using a test client",\n                    "width": "undefined",\n                    "height": "undefined",\n                    "target": "test-message.png"\n                }\n            },{\n                "type": "paragraph",\n                "text": "In doing so, you published a message to your server, and in the Test Client you're listening to your own topic. This UI proves that your client is working with the Pulsar server."\n                \n            },{\n                "type": "paragraph",\n                "text": "See the <<codeSamples,Code samples>> section for a look at the clients."\n                \n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "On the Pulsar Admin Console's Code Samples page, there are examples of Java, Python, Golang, Node.js, WebSocket, and HTTP clients.  Each example shows Producer, Consumer, and Reader code; plus language-specific examples of setting project properties and dependencies. For example with Java, if you are using Maven in your project, add the following to the `<properties>` section of your `pom.xml` file:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`<pulsar.version>{pulsar-version}</pulsar.version>`"\n                \n            },{\n                "type": "paragraph",\n                "text": "And add the following to the `pom.xml` file's `<dependencies>` section:"\n                \n            },{\n                "type": "listing",\n                "content": "&lt;dependency&gt;  &lt;groupId&gt;org.apache.pulsar&lt;/groupId&gt;  &lt;artifactId&gt;pulsar-client&lt;/artifactId&gt;  &lt;version&gt;${pulsar.version}&lt;/version&gt;&lt;/dependency&gt;"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "If you are using Gradle, add this to your `build.gradle` file:"\n                \n            },{\n                "type": "listing",\n                "content": "def pulsarVersion = {pulsar-version}dependencies {    compile group: 'org.apache.pulsar', name: 'pulsar-client', version: pulsarVersion}"\n                , "links": []\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "To connect using the Pulsar binary protocol, use the following URL format with port 6651:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`pulsar+ssl://<dns-name>:6651`"\n                \n            },{\n                "type": "paragraph",\n                "text": "For example, for an installed node with a DNS name ip-10-101-32-250.srv101.dsinternal.org:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`pulsar+ssl://ip-10-101-32-250.srv101.dsinternal.org:6651`"\n                \n            },{\n                "type": "paragraph",\n                "text": "To connect using the WebSocket API, use the following URL format with port 8001:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`wss://<dns-name>:8001`"\n                \n            },{\n                "type": "paragraph",\n                "text": "For example:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`wss://ip-10-101-32-250.srv101.dsinternal.org:8001`"\n                \n            },{\n                "type": "paragraph",\n                "text": "To connect using HTTP, use the following URL format with port 8085:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`https://<dns-name>:8085`"\n                \n            },{\n                "type": "paragraph",\n                "text": "For example:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`https://ip-10-101-32-250.srv101.dsinternal.org:8085`"\n                \n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "To connect to the admin API, use the following URL format with port 8443:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`https://<dns-name>:8443`"\n                \n            },{\n                "type": "paragraph",\n                "text": "For example, give a DNS name of ip-10-101-32-250.srv101.dsinternal.org:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`https://ip-10-101-32-250.srv101.dsinternal.org:8443`"\n                \n            },{\n                "type": "paragraph",\n                "text": "You can list all the tenants like this, for example:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`pulsar-admin --admin-url https://ip-10-101-32-250.srv101.dsinternal.org:8443`"\n                \n            },{\n                "type": "paragraph",\n                "text": "Or if you have authentication enabled, like this:"\n                \n            },{\n                "type": "listing",\n                "content": "pulsar-admin --admin-url https://ip-10-101-32-250.srv101.dsinternal.org:8443 --auth-plugin org.apache.pulsar.client.impl.auth.AuthenticationToken ----auth-params file:///token.jwt"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "You can get the token from the Pulsar Admin Console's Credentials page."\n                \n            },{\n                "type": "paragraph",\n                "text": "Alternatively, you can save the URL authentication parameters in your `client.conf` file."\n                \n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "section",\n                "title": "Connect token",\n                "content": [{\n                "type": "paragraph",\n                "text": "When connecting clients, you'll need to provide your connect token to identify your account. In all the Pulsar APIs, you specify the token when creating the client object. The token is your password to your account, so keep it safe."\n                \n            },{\n                "type": "paragraph",\n                "text": "The code samples automatically add your client token as part of the source code for convenience. However, a more secure practice would be to read the token from an environment variable or a file."\n                \n            },{\n                "type": "paragraph",\n                "text": "In the Pulsar Admin Console's Credentials page, click **Create New token** and follow the instructions.  If you previously created a token, use the Credentials page to get its value."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "CA Certificate",\n                "content": [{\n                "type": "paragraph",\n                "text": "The cluster may be using certificates signed by trusted certicate authorities, such as https://letsencrypt.org/[Let's Encrypt, window=_blank]. That means that you can use the default set of certificate authorities in your environment. The path to the default CA bundle varies by environment. For example:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "`/etc/ssl/certs/ca-bundle.crt` (RHEL/CentOS)",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "`/etc/ssl/certs/ca-certificates.crt` (Debian/Ubuntu)",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "paragraph",\n                "text": "On OSX, run this command to export the default certificates to a file:"\n                \n            },{\n                "type": "paragraph",\n                "text": "`security find-certificate -a -p /System/Library/Keychains/SystemCACertificates.keychain > ca-certificates.crt`"\n                \n            },{\n                "type": "paragraph",\n                "text": "If the cluster is not using a public certificate authority, you can use the Pulsar Admin Console's Credentials page to display it with **Click to Show CA Certificate**."\n                \n            },{\n                "type": "paragraph",\n                "text": "Most Pulsar APIs can be configured to skip certificate validation, but this is not recommended."\n                \n            }]\n            }]\n        }]\n            }

admin-console-tutorial

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-mappings.adoc[Mapping Pulsar concepts to JMS]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-mappings.adoc",\n                "name": "pulsar-jms-mappings",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Mapping Pulsar concepts to JMS"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "xref:0",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-implementation.adoc[Implementation details]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-implementation.adoc",\n                "name": "pulsar-jms-implementation",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Implementation details"\n            }]\n                }]\n            },{\n                "raw": "xref:index.adoc[About]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "index.adoc",\n                "name": "index",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "About"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "raw": "xref:pulsar-jms-install.adoc[Installation]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-install.adoc",\n                "name": "pulsar-jms-install",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Installation"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "raw": "xref:pulsar-jms-quickstart-sa.adoc[Pulsar standalone quick start]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-sa.adoc",\n                "name": "pulsar-jms-quickstart-sa",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar standalone quick start"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "raw": "xref:pulsar-jms-quickstart-astra.adoc[Astra Streaming quick start]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-astra.adoc",\n                "name": "pulsar-jms-quickstart-astra",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Astra Streaming quick start"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "raw": "xref:pulsar-jms-reference.adoc[Reference]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-reference.adoc",\n                "name": "pulsar-jms-reference",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Reference"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "xref:0",\n                "content": [{\n                "raw": "xref:pulsar-jms-faq.adoc[FAQs]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-faq.adoc",\n                "name": "pulsar-jms-faq",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "FAQs"\n            }\n                ]\n            },{\n                "type": "list_item",\n                "text": "{jms_repo}[Github repo,window=_blank]",\n                "content": [\n                ]\n            }]\n        }]\n            }

{\n                "type": "document",\n                "content": [{\n                "type": "preamble",\n                "content": [{\n                "type": "paragraph",\n                "text": "{starlight_jms} is the first highly compliant JMS implementation designed to run on a modern streaming platform. It allows enterprises to take advantage of the scalability and resiliency of a modern streaming platform to run their existing JMS applications. Because Apache Pulsar™ is open-source and cloud-native, {starlight_jms} enables enterprises to move their JMS applications to run on-premises and in any cloud environment."\n                \n            }]\n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "{starlight_jms} key features include:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*Blazing fast JMS performance*: Achieve 1 million JMS messages per second with 99 percentile publish to acknowledge latency of less than 10 ms.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Drop-in replacement for existing JMS applications*: Supports JMS/Jakarta 2.0 and is backwards compatible with JMS 1.1. 100% pass rate on JMS compliance test for supported features.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Horizontally scalable JMS*: Apache Pulsar is a horizontally scaled distributed streaming platform. You can scale up or down without operational hassles. Pulsar separates compute from storage, which means you can scale those dimensions independently, as required. Pulsar supports offloading old data to object storage for practically infinite storage capacity.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Reduced total cost of ownership*: Because Apache Pulsar is natively multi-tenant and high performance, you can consolidate JMS applications spread across multiple legacy JMS brokers onto a single Apache Pulsar installation. And since Pulsar is easily horizontally scaled, you don’t need to overprovision.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Future proof*: Apache Pulsar can support traditional messaging workloads, but it can also support modern streaming use cases such as log collection, microservices integration, event streaming, event sourcing. New workloads can run alongside Legacy JMS applications.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Open source to avoid lock in*: {starlight_jms} and Apache Pulsar are 100% open source. You can run on-premise, in any cloud provider, or in Kubernetes.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Adds message replay to JMS*: Apache Pulsar natively supports message retention and replay. This allows applications using Fast JMS for Apache Pulsar to travel back in time and replay previously consumed messages to recover from misconfiguration issues, recover from bugs in application code, and test new applications against real data.",\n                    "content": []\n                    \n                }]\n            }]\n        },{\n                "type": "section",\n                "title": "Next",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*xref:0*: Create a simple command line Java JMS client that connects to a local Pulsar installation.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-quickstart-sa.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-sa.adoc",\n                "name": "pulsar-jms-quickstart-sa",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Quickstart Sa"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Create a simple command line Java JMS client that connects to an Astra Streaming instance.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-quickstart-astra.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-astra.adoc",\n                "name": "pulsar-jms-quickstart-astra",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Quickstart Astra"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Install {starlight_jms} in your own JMS project.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-install.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-install.adoc",\n                "name": "pulsar-jms-install",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Install"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Understand Pulsar concepts in the context of JMS.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-mappings.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-mappings.adoc",\n                "name": "pulsar-jms-mappings",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Mappings"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Understand key implementation details for {starlight_jms}.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-implementation.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-implementation.adoc",\n                "name": "pulsar-jms-implementation",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Implementation"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Frequently asked questions about {starlight_jms}.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-faq.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-faq.adoc",\n                "name": "pulsar-jms-faq",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Faq"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: {starlight_jms} configuration reference.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-reference.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-reference.adoc",\n                "name": "pulsar-jms-reference",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Reference"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*{jms_repo}[{starlight_jms} Github repo,window=_blank]*",\n                    "content": []\n                    \n                }]\n            }]\n            }]\n            }

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "Install {starlight_jms} by adding the following dependency to your Java Maven project `pom.xml`:"\n                \n            },{\n                "type": "listing",\n                "content": "&lt;dependency&gt;   &lt;artifactId&gt;pulsar-jms&lt;/artifactId&gt;   &lt;groupId&gt;com.datastax.oss&lt;/groupId&gt;   &lt;version&gt;1.0.0&lt;/version&gt;&lt;/dependency&gt;"\n                , "links": []\n            },{\n                "type": "paragraph",\n                "text": "That file contains only {starlight_jms} code and transitively imports the Apache Pulsar™ client and the Jakarta JMS 2.0 specifications JAR."\n                \n            },{\n                "type": "paragraph",\n                "text": "You can also use a \"fat\" JAR that includes all dependencies:"\n                \n            },{\n                "type": "listing",\n                "content": "&lt;dependency&gt;   &lt;artifactId&gt;pulsar-jms-all&lt;/artifactId&gt;   &lt;groupId&gt;com.datastax.oss&lt;/groupId&gt;   &lt;version&gt;1.0.0&lt;/version&gt;&lt;/dependency&gt;"\n                , "links": []\n            }]\n        },{\n                "type": "section",\n                "title": "Next",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*xref:0*: Create a simple command line Java JMS client that connects to a local Pulsar installation.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-quickstart-sa.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-sa.adoc",\n                "name": "pulsar-jms-quickstart-sa",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Quickstart Sa"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Create a simple command line Java JMS client that connects to an Astra Streaming instance.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-quickstart-astra.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-quickstart-astra.adoc",\n                "name": "pulsar-jms-quickstart-astra",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Quickstart Astra"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Understand Pulsar concepts in the context of JMS.*xref:1*: Understand key implementation details for {starlight_jms}.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-mappings.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-mappings.adoc",\n                "name": "pulsar-jms-mappings",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Mappings"\n            },{\n                "raw": "xref:pulsar-jms-implementation.adoc[]",\n                "type": "xref",\n                "identifier": "xref:1",\n                "filename": "pulsar-jms-implementation.adoc",\n                "name": "pulsar-jms-implementation",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Implementation"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: Frequently asked questions about {starlight_jms}.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-faq.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-faq.adoc",\n                "name": "pulsar-jms-faq",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Faq"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*xref:0*: {starlight_jms} configuration reference.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:pulsar-jms-reference.adoc[]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "pulsar-jms-reference.adoc",\n                "name": "pulsar-jms-reference",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "Pulsar Jms Reference"\n            }]\n                }, {\n                    "type": "uitem",\n                    "text": "*{jms_repo}[{starlight_jms} Github repo,window=_blank]*",\n                    "content": []\n                    \n                }]\n            }]\n            }]\n            }

pulsar-jms-install

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Download xref:0.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:obtaining-database-credentials.adoc[your secure connect bundle]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "obtaining-database-credentials.adoc",\n                "name": "obtaining-database-credentials",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "your secure connect bundle"\n            }]\n                }]\n            },{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Push your secure connect bundle to your GitHub repo for the code you are using.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "admonition",\n                "style": "WARNING",\n                "content": [{\n                "type": "paragraph",\n                "text": "Do not unzip your secure connect bundle."\n                \n            }]\n            },{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Pass the path to your connection string as you install your DataStax driver via the integrated CLI using the xref:0.",\n                    "content": []\n                    , "links": [{\n                "raw": "xref:connecting-to-astra-databases-using-datastax-drivers.adoc[instructions for your driver]",\n                "type": "xref",\n                "identifier": "xref:0",\n                "filename": "connecting-to-astra-databases-using-datastax-drivers.adoc",\n                "name": "connecting-to-astra-databases-using-datastax-drivers",\n                "extension": "adoc",\n                "anchor": "",\n                "text": "instructions for your driver"\n            }]\n                }]\n            },{\n                "type": "admonition",\n                "style": "NOTE",\n                "content": [{\n                "type": "paragraph",\n                "text": "If you are using the Python driver, you must use the latest driver. Previous version do not work with Ubuntu 20.04."\n                \n            }]\n            },{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Import or add your GitHub repository to the IDE.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Make any code modifications you want in the IDE.",\n                    "content": []\n                    \n                }]\n            },{\n                "type": "olist",\n                "items": [{\n                    "type": "oitem",\n                    "text": "Execute the code in the integrated CLI.",\n                    "content": []\n                    \n                }]\n            }]\n        }]\n            }

{\n                "type": "document",\n                "content": [{\n            "type": "block",\n            "blocks": [{\n                "type": "paragraph",\n                "text": "DataStax Astra security features frequently asked questions."\n                \n            },{\n                "type": "paragraph",\n                "text": "Questions and answers about Astra security are provided in these categories:"\n                \n            },{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "<<General>>",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "<<Encryption>>",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "<<Authentication and authorization>>",\n                    "content": []\n                    \n                }]\n            }]\n        },{\n                "type": "section",\n                "title": "General",\n                "content": [{\n                "type": "section",\n                "title": "What communication protocols are used?",\n                "content": [{\n                "type": "paragraph",\n                "text": "All communication occurs over TCP sockets and can be secured by using the standard Java Security SSL/TLS implementation in the JVM.Additional application specific protocols like gossip and the CQL Binary Protocol rely on these sockets for transport."\n                \n            }]\n            }]\n            },{\n            "type": "block",\n            "blocks": [{\n                "type": "section",\n                "title": "How are encryption keys secured and managed?",\n                "content": [{\n                "type": "paragraph",\n                "text": "Each DataStax Astra database provides a secure private endpoint, which requires mutual-TLS authentication.Users have access to only databases in their Organization.Neither the Virtual Machines (VMs) nor the storage are accessible by anyone outside of the Organization that the Astra database is linked to aside from DataStax Support."\n                \n            },{\n                "type": "paragraph",\n                "text": "All data in transit is encrypted until it moves into the secured network, and all database volumes are encrypted."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "Can the client-to-node encryption be configured as a two-way SSL?",\n                "content": [{\n                "type": "paragraph",\n                "text": "Yes, although the client certificate DN is not used as a database user principal.Client-to-node encryption protects in-flight data from client machines to a database cluster using SSL (Secure Sockets Layer) and establishes a secure channel between the client and the coordinator node."\n                \n            }]\n            }]\n        },{\n            "type": "block",\n            "blocks": [{\n                "type": "section",\n                "title": "How are user permissions managed?",\n                "content": [{\n                "type": "paragraph",\n                "text": "The default user can create and delete other roles and grant or revoke permissions."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "How are user-action permissions supported?",\n                "content": [{\n                "type": "paragraph",\n                "text": "DSE supports standard object permission management to assign roles specific permissions at the table and row level.Permissions to access all keyspaces, a named keyspace, a table, function, or MBean can be granted to a role."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "What authentication mechanisms are supported?",\n                "content": [{\n                "type": "ulist",\n                "items": [{\n                    "type": "uitem",\n                    "text": "*Internal*: Connections provide credentials for a role that has an internally stored password.No additional configuration is required.",\n                    "content": []\n                    \n                }, {\n                    "type": "uitem",\n                    "text": "*Kerberos*: Connections provide a Kerberos ticket.DSE is configured as a Service Principal and passes the tickets to KDS for verification.",\n                    "content": []\n                    \n                }]\n            }]\n            },{\n                "type": "section",\n                "title": "Can access be restricted using IP whitelisting and blacklisting?",\n                "content": [{\n                "type": "paragraph",\n                "text": "In general, arbitrary client programs do not access the database.Database access by the general user population is controlled at the application layer.Application node to database node access should be controlled by using conventional firewall mechanisms, such as Linux iptables.However, database administrators are an exception to allow connections from DBA hosts."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "What granularity of access to specific elements of data is supported?",\n                "content": [{\n                "type": "paragraph",\n                "text": "Authorization is granted or revoked at the row level for data."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "What is the difference between RBAC and RLAC?",\n                "content": [{\n                "type": "paragraph",\n                "text": "Role-based access control (RBAC) refers to authorization to any database resource.Row-level access control (RLAC) refers to the feature that allows permissions to be granted/revoked on rows within a table by filtering a text-based partition column.{astra_db} does not support RLAC."\n                \n            }]\n            },{\n                "type": "section",\n                "title": "What is the port range for the secure connect bundle?",\n                "content": [{\n                "type": "paragraph",\n                "text": "The port range for your secure connect bundle is 30000-32767."\n                \n            }]\n            }]\n        }]\n            }

security-faqs

curl -L -X POST 'http://localhost:8081/v1/auth' \\n  -H 'Content-Type: application/json' \\n  --data-raw '{\n    "username": "cassandra",\n    "password": "cassandra"\n}'\n

get-table-based-token

npm i @stargate-oss/stargate-grpc-node-client\n

node-npm

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh\n

rust-build1

ccm create stargate -v 3.11.8 -n 1 -s -b\n./starctl --cluster-name stargate --cluster-seed 127.0.0.1 --cluster-version 3.11 \\n          --listen 127.0.0.2 --bind-to-listen-address --simple-snitch\nObtain the authentication token:\n\ncurl -L -X POST 'http://127.0.0.2:8081/v1/auth' \\n     -H 'Content-Type: application/json' \\n     --data-raw '{\n        "username": "cassandra",\n        "password": "cassandra"\n     }'\n\n{"authToken":"2df7e75d-92aa-4cda-9816-f96ccbc91d80"}\nSet the authentication token variable:\n\nexport SG_TOKEN=2df7e75d-92aa-4cda-9816-f96ccbc91d80\n

start-sg-ccm

CREATE INDEX evalk_idx ON users_keyspace.users (KEYS (evaluations));\nCREATE INDEX evalv_idx ON users_keyspace.users (VALUES (evaluations));\nCREATE INDEX evale_idx ON users_keyspace.users (ENTRIES (evaluations));\n

create_index_map

CREATE CUSTOM INDEX books_idx \n  ON users_keyspace.users (VALUES(favorite_books)) \n  USING 'StorageAttachedIndex'\n  WITH OPTIONS = ('case_sensitive': 'false');\n

create_index_set_sai

curl --request POST \\n  --url 'https://api.astra.datastax.com/v2/organizations/clusters/<databaseID>/datacenters/<datacenterID>/endpoints' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>' \\n  --data '[\n      "endpointID": "vpce-svc-1148ea04af491da11",\n      "description": "project-desc-dev-app"\n    ]'\n

curl_create_private_endpoint_connection

curl --request POST \\n  --url 'https://api.astra.datastax.com/v2/organizations/roles' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>' \\n  --data '{\n    	"name":"<roleName>",\n    	"policy": {\n    	  "description": "Create and describe keyspaces",\n    	  "resources": ["drn:astra:org:<organizationId>"],\n    	  "actions": ["db-all-keyspace-create", "db-all-keyspace-describe"],\n    	  "effect": "allow"}\n    }'\n

curl_create_role

curl --request DELETE \\n --url 'https://api.astra.datastax.com/v2/organizations/users/<userId>' \\n --header 'Accept: application/json' \\n --header 'Authorization: Bearer <application_token>'\n

curl_delete_user

curl --request GET \\n  --url 'https://api.astra.datastax.com/v2/databases/<databaseId>/access-list' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>'\n

curl_get_access_list

curl --request GET \\n  --url 'https://api.astra.datastax.com/v2/access-list/template' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>'\n

curl_get_access_list_template

curl --request GET \\n  --url 'https://api.astra.datastax.com/v2/access-lists' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>'\n

curl_get_all_access_lists

curl --request GET \\n --url 'https://api.astra.datastax.com/v2/clientIdSecrets' \\n --header 'Accept: application/json' \\n --header 'Authorization: Bearer <application_token>'\n

curl_get_clients

curl --request GET \\n --url 'https://api.astra.datastax.com/v2/databases/<databaseID>/datacenters' \\n --header 'Accept: application/json' \\n --header 'Authorization: Bearer <application_token>'\n

curl_get_regions

curl --request POST \\n  --url 'https://api.astra.datastax.com/v2/databases/<databaseId>/access-list' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>' \\n  --data '{\n      [\n        "address": "125.187.17.0/24",\n        "enabled": true,\n        "description": "Development"\n      ]\n    }'\n

curl_post_add_addresses

curl --request GET \\n  --url 'https://api.astra.datastax.com/v2/organizations/clusters/<databaseID>/private-link' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>'\n

curl_get_private_endpoint_connections_db

curl --request POST \\n  --url 'https://api.astra.datastax.com/v2/organizations/clusters/<databaseID>/datacenters/<datacenterID>/private-link' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>' \\n  --data '{\n      "allowedPrincipals": [\n        "arn:aws:iam::123456789012:role/admin"\n      ]\n    }'\n

curl_post_private_endpoint_aws_principal

curl --request PUT \\n  --url 'https://api.astra.datastax.com/v2/organizations/clusters/<databaseID>/datacenters/<datacenterID>/private-link' \\n  --header 'Accept: application/json' \\n  --header 'Authorization: Bearer <application_token>' \\n  --data '{\n      "allowedPrincipals": [\n        "bab9a808-8b13-4af6-b712-53efa34c0d46"\n      ]\n    }'\n

curl_put_private_endpoint_azure_principal

curl -sL -X  DELETE --url {base_url}{base_doc_api}/{namespace}/collections/{collection}?where=\{"id":\{"$eq":"some%2Dstuff"\}\} \\n--header "X-Cassandra-Token: {auth_token}" \\n--header 'Content-Type: application/json'\n

curl_delete_doc_where

curl -sL -X  GET --url {base_url}{base_doc_api}/{namespace}/collections/{collection}/Joey.weights[0] \\n--header "X-Cassandra-Token: {auth_token}" \\n--header "Content-Type: application/json"\n

curl_get_array

curl -sL -X  GET --url '{base_url}{base_doc_api}/{namespace}/collections/{collection}?where=\{"firstname":\{"$eq":"Janet"\},"lastname":\{"$eq":"Doe"\}\}' \\n--header "X-Cassandra-Token: {auth_token}" \\n--header 'Content-Type: application/json'\n

curl_get_doc_mult_where

curl -sL -X  GET --url '{base_url}{base_doc_api}/{namespace}/collections/{collection}?where=\{"firstname":\{"$eq":"Janet"\}\}' \\n--header "X-Cassandra-Token: {auth_token}" \\n--header 'Content-Type: application/json'\n

Filter Results: