Getting unencoded data from Google cloud Pub/Sub instead of base64

daoudc :

I'm attempting to use the Python library for Pub/Sub, but I keep getting this error: TypeError: Incorrect padding. Some quick googling revealed this issue: https://github.com/GoogleCloudPlatform/google-cloud-python/pull/2527

However, this doesn't resolve the issue - in fact, printing out the data revealed that the data was not even base64 encoded at all, and setting data = raw_data in the library resolved the issue.

We're sending the message from Java, here is the code we're using:

PCollection<String> userActionsJson = userActionsRaw.apply(ParDo.of(new BigQueryRowToJson()));
       String topicNameFull = "projects/" + options.getProject() + "/topics/" +
               options.getUsersActionsTopicName() + "-" + options.getProduct();
       userActionsJson.apply(PubsubIO.Write.named("PublishToPubSub")
               .topic(topicNameFull));

however, the same thing happens attempting to send a message through the console.

Has something changed recently to mean that data is no longer base64 encoded?

daoudc :

This was an issue that has now been resolved in master: https://github.com/GoogleCloudPlatform/google-cloud-python/issues/2577

Guess you like

Origin http://10.200.1.11:23101/article/api/json?id=453534&siteId=1

Getting unencoded data from Google cloud Pub/Sub instead of base64

Read parquet data from ByteArrayOutputStream instead of file

Getting versionCode and VersionName from Google Play

Firebase Cloud Messaging notification from Java instead of Firebase Console

data: image / png; base64 application

JSON data conversion base64 method

Getting a specific category of data from firebase

Getting data from firebase in a synchronized way

Getting no data from the LiveData observer of a database

Redis (spring data redis) publish subscribe pub / sub

Invoke a Google Cloud Run from java

Getting streamable link from Google Drive [Code is ready, Access is denied]

Getting started with AI starts with these 10 standalone courses from Google

Why is Integer written instead of int when using JavaBean to receive fields from the database? Why does the data layer return integer instead of int?

Python output numpy array as base64 encoded string instead of jpg

data:image/jpg; convert base64 format data into pictures

base64 convert the picture file, and upload it to the cloud Ali

An article to understand Spring Cloud Gateway (from getting started to giving up)

Oracle blob data into a base64 encoding type

Java processing in the interface returns base64 encoded image data

illegal base64 data at input byte 37

js uses canvas to convert text into image data base64

[Python Intermediate] Base64 encoding converts image data into strings

Convert base64 file data in vue and download it through blob

jQuery uploads base64 format files to the background and reads base64 format files from the background (transmission in string format)

Android image data format conversion url image address to base64, url to Bitmap, Bitmap to base64, base64 to Bitmap, ImageView loading Bitmap, rotating image angle

Getting started with Redis, starting from the underlying data structure and application principles

getting data from system environment variable using spring 4

Synchronization problem while getting data from firebase database

Spring Data JPA getting a Projection from an Entity with a Query