I'm using websocket-client, where I get binary responses (base64), where I can turn them into utf-8 without any problem. The current problem is that even converting the websocket response to utf-8, it seems to come compressed, I'm not sure because it shows unknown characters. I've tried in every way to unzip the answer using the zlib and gzip libraries, but it generates this error:
Error -3 while decompressing data: incorrect header check
My raw answer:
\x80\x00P\x12\x00\x03\x00\x01p\x12\x00\x02\x00\x01p\x12\x00\x02\x00\x04code\x04\x00\x00\x00\xc8\x00\ ronlinePlayers\x05\x00\x00\x00\x00\x00\x00\x02\xa4\x00\x01c\x08\x00\ronlinePlayers\x00\x01a\x03\x00\r\x00\x01c\x02\x01
My decoded answer (to base64):
gABQEgADAAFwEgACAAFwEgACAARjb2RlBAAAAMgADW9ubGluZVBsYXllcnMFAAAAAAAAAqQAAWMIAA1vbmxpbmVQbGF5ZXJzAAFhAwANAAFjAgE=
Same answer decoded, but using an online conversion site (ends up showing unknown characters):
�P � � p � � p � � code ����
onlinePlayers ������ � c �
onlinePlayers� to �
� c
I don't know this kind of answer, I would like to understand what it is, if it's some kind of encryption, compression, or simply how to get the answer clean (with understandable characters).
Related
I have base64 encoded text and I try to decode it but when I decode it, it contains some unknown characters. But the interesting part is, decoded text contains that I need data. So just I need to remove unknown characters and I need to split the data.
Do you have any suggestion to escape this unknown characters?
E.g base64 data:
Ct5bChoKCgjOzdDH7KDX+X4SCgjb1uri1IOfgUUaABABMgVlbi1VUzrYJAoFZW4tVVMaCVdpbiBDb2xvciK7C1dpbiBDb2xvciBvciBDb2xvciBXaW4gaXMgbm90IGp1c3QgYSBnYW1lLiBJdCBpcyBhIGlkZW9sb2d5IGluIHRoZSBzYW1lIHRpbWUuCldhdGNoIG91dDogU29tZSBjb2xvcnMgd2lsbCBhcHBlYXIgb24gdGhlIHNjcmVlbi4gVHJ5IHRvIGtlZXAgYWxsIG9mIHRoZW0gaW4geW91ciBtZW1vcnkuIFRoaXMgd2lsbCBtYWtlIHlvdXIgbWVtb3J5IHN0cm9uZ2VyIGFuZCB3aWxsIGltcHJvdmUgeW91ciBtZW1vcnkgY2FwYWJpbGl0aWVzLgpOb3RpY2U6IFRha2UgY29udHJvbCBvZiB0aGUgZW50aXJlIGZpZWxkLiBFdmVuIG5vdGljZSB0aGUgc2xpZ2h0ZXN0IGNoYW5nZS4gVGhpcyB3aWxsIG1ha2UgeW91IG1vcmUgY2FyZWZ1bCBhbmQgZ2l2ZSB5b3UgbmV3IHBlcmNlcHRpb24gZmVhdHVyZXMuCkZpbmQ6IE1hdGNoIGNvbG9ycy4gRmluZCBsb3N0LCBtaXNzaW5nIGNvbG9ycy4gU29tZSBjb2xvcnMgd2lsbCBiZSB2ZXJ5IGNsb3NlIHRvZ2V0aGVyLiBUaGlzIHdpbGwgZW5oYW5jZSB5b3VyIGFiaWxpdHkgdG8gcmVjb2duaXplIGRldGFpbHMuCldpbjogVGhlcmUgaXMgbm8gbG9zaW5nIGhlcmUuIFlvdSB3aW4gd2hhdGV2ZXIgeW91IGRvLiBCdXQgeW91IHN0aWxsIGZvY3VzIG9uIHdpbm5pbmcgYSBsb3QuClRpbWU6IERvIG5vdCBmb3JnZXQgdGhhdCB5b3UgaGF2ZSBhIGNlcnRhaW4gdGltZSB0byB3aW4gc29tZSB0aGluZ3MuIExlYXJuIGhvdyB0byB1c2UgeW91ciB0aW1lIGFuZCBwbGFuLgpMaWZlOiBZb3UgaGF2ZSBhIGNoYW5jZSBmb3Igc29tZXRoaW5nLiBCdXQgYSBjZXJ0YWluIG51bWJlci4gTmV2ZXIgZm9yZ2V0IHRoZSBudW1iZXIgb2YgdGhlc2UgY2hhbmNlcy4KCkEgZ3JlYXQgZ2FtZSBmcm9tIFNoYSBHYW1lcyBtYWtlcnMuCgotIFdhdGNoIG91dCwgbm90aWNlLCBmaW5kIHRoZSBjb2xvciBhbmQgd2luLgotIDQ1IGxldmVscyBpbiB0b3RhbC4KLSA0MCBkaWZmZXJlbnQgY29sb3Igb3B0aW9ucwotIFJpY2ggdmlzdWFsIGludGVyZmFjZS4KLSBVbmxpbWl0ZWQgZW50ZXJ0YWlubWVudC4KCjggZGlmZmVyZW50IGxhbmd1YWdlIHN1cHBvcnQ6CiAtIEVuZ2xpc2gKIC0gVHVya2lzaAogLSBSdXNzaWFuCiAtIENoaW5lc2UKIC0gU3BhbmlzaAogLSBBcmFiaWMKIC0gSmFwYW5lc2UKIC0gR2VybWFuCiAtIEZyZW5jaAogCkdhbWVwbGF5OgotIFdhdGNoIG91dCBmb3IgdGhlIGNvbG9ycyBpbiB0aGUgbWlkZGxlLgotIEFmdGVyIGEgd2hpbGUsIG5vdGljZSB0aGUgZGlzYXBwZWFyYW5jZXMgb2YgdGhlc2UgY29sb3JzIGFuZCBpZGVudGlmeSB0aGVtLgotIFNlbGVjdCB0aGUgY29sb3JzIHlvdSBzcGVjaWZ5IGZyb20gdGhlIGNvbG9yIHBhbmVsLgoKRm9sbG93IFVzOgotIGh0dHBzOi8vd3d3LmZhY2Vib29rLmNvbS9zaGFnYW1lcwotIGh0dHBzOi8vdHdpdHRlci5jb20vc2hhX2dhbWVzCi0gaHR0cHM6Ly9wbHVzLmdvb2dsZS5jb20vdS8wLzExMTMwOTUyMjcxNTM1MjE2ODY4OSpPQ29sb3IsIHdpbiwgbm90aWNlLCBsb3N0IGNvbG9yLCBtaXNzaW5nIGNvbG9yLCByZW1lbWJlciwgZm9jdXMsIHdhdGNoIG91dCwgZmluZDK0GArSCgqNAgqbAUFJNHhNTjE0aHYzM3dNS3o4NmRoMHVxREpZaUc0dThacnVkdC1ha0J0blZwS19sWUJQSmVHbjdXU3F5aEJTR3N2T2JEMmtDc3hPUkg1U3Bfd3FiZ0Nyc2dhdVA1akl2MU5SblhvcFZ2bndvNTFMN3ViRVpWb3dDcE1LcnI4TWo3ZjRESkJPdm1qeUlZYlhuMU9aSTl5YVBxS093EmVodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vakFkbV9Jc2lhVGF5WXVTN1Zod05SbGUyMlZXRFM2Tzc5OU9OYlFTR1MzNmJhMU1STWViS2pWMTdCVEk1bXFmbHBjdxjQDyDoByoACowCCpsBQUk0eE1OMHBTUDNlYXc3ODV4UGVlbzRHbmh0eEdPXy1rLTZ3YllLSk9qLXRIUUp6czZCTmQzaHVGcHNhUDRWd3ZOUmZFcE1OZGhSWGdtOThZMldCMjB0d0tUYmdGc00zY2xGSlM1NS1sbWVIUnVqakVRVl9ZS2JZTUdyanFVdU1rVkI1Q3lhdnZXUHZrcTRSTHpIQ3dTVG41c1ESZGh0dHBzOi8vbGgzLmdvb2dsZXVzZXJjb250ZW50LmNvbS9SQlIwcFJsNHhMdmRPU2ZscEdsV0NySU5oVjZtMjlQYjJYT01Ob1ZOX0RLVHFrZEFMRDRFUE9wdlVLZE1felpyYkEY0A8g6AcqAAqNAgqbAUFJNHhNTjNEVnpDVFRSc2dTRXN4YmlSOHBZVmkwa19kdDY1d0lWMWJmTFZaWk16bjcwbU05aTMwUWQ0THpHeE9fdHJBUlUxOGRjclJBUC1sV1NzcGtvMDB2VVlOMlljWkJOUllDVXBBVHZqRllGT3JmdlBsb0l6TFdBeEhCaV9xMGJRTVVWelBFZ2VIbWp1eTl6VktyLTA0aE5BEmVodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vR3FaOGNyLXhWOU5tNDZlZ0Zfb0tSdG5BR3dpUnQtdGlEZEtaUkNzVWhHbUtRN0FLa0cwUks5RkthQTJYOTRxZHlSVRjQDyDoByoACo0CCpsBQUk0eE1OM0lXS1lPZFcwT3VxNG9JMF9EYkxLV1lFb20wMGxvTlRxX3MtNUpVWlptNEltOVQ4Zk1KcW82dk42SlVOV3pLcnNrTm51T2JrMVlWYW8zRjBKR0ZwdENJdHR4MnlCSF93SXFWQjVFQTRxOUJEd3JMdERxRXZoYnAzVmw1TWRTdkttemF5VHVQTnFZTW5ZNTlCcFZsWFESZWh0dHBzOi8vbGgzLmdvb2dsZXVzZXJjb250ZW50LmNvbS9XR3p3T3AtT2FVQk81OE4wekhBdG5hZ216NTVOSzF5MGpuZWk4bFBsUU0yUFZGcmhZekRzazFSdlBRRVRqc2JyNGk0GNAPIOgHKgAKjgIKmwFBSTR4TU4wQkswUWJvbEVHR2ZJeHFVOE4yOGxocnc0Y19iODY5OWRlXzVpdXZ5OGJYMmdfRVU5azQyOWhNSk9GOWdYVjNieGJfczhHTDZoUXNoQm9JX002N21ibEl2bEc4Q0FSWVAzLTF1NF9ObEhoVmw3bHNYNjBVOC1aam5xZ2JFdE5ERXpuVEpVZi1PbmR1Ny1Nam5iejFnYxJmaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL2hEbDB3UExMMWdqcDBWQ0p0R3ZCcVJ2SW8zcHJIYmlyVEd0TlBubERMM3hnZjBuM3dvYXpDMVppMUtCX2N4c1Y5ZndnGNAPIOgHKgAQAQqSAgqNAgqbAUFJNHhNTjBNT3pLcGdoMm5STFgyZnNfSktSR0g0NmFIYjg2YnRNUklDTzVJZmhvSnJLZFdxWDdCS1ZTTXpOVFFod2lGY0hyaTNvclQ4cHBWa1lpeE01bVBoNWxSbDFXRWFubHJsSFJGTXhBSFgyOVk1NFJucDlUVWFoN2VpNWV0X3Vyci1KQjY4Y20tWTV5cG1Odm5weFpIRlh3EmVodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vMS1oNTU3MWFvRG1Pdjh2NUlmWklGdm1ZRGo4Y21Eb2lfM0Jac1BDZEZ1djFWYXA2enJoVHp6cXBNTTByWnBlN1o2VRjkCiCaCCoAEAIKsgYKjQIKmwFBSTR4TU4yNUc2WmxValJNMTBmUFRPY3kyeVQwa3lNR1hwdzQ2VmJCZEVBbmw5dU5pYXlWTHpkWkpMb0M4RmtCNmJYakIzMWxjakl0TWlsamdMTDl0RUljRGktbU1nWWRKN0hTSHg1RHRNblg5YXlVWFg4MlpBM241ZU9DRjF1Sktkdmw5OXJrMExHNm9OWVVnZ2Y2b2EyMzE5QRJlaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL3E1bF9JdmFXdDJTaTVpbTRKYk42ZmNRZzdQenlsZGlxcVEwM2ZJbElsZkxNaURKNDRHa21VZ2IzUVFWdU1VUU9xSDQY5AogrAcqAAqOAgqbAUFJNHhNTjNmeDlvVHpxMHFneFNDUzBaSzIyRURzeXZSY21mT1h1d01tWVpIakY3SXBYR0p4RGZWR2VjRVozLWNTTHRJNlpmTG1RUXBZV2VsbDJNQVpUSm5yYzRVRm03UXlMWGRMcURIaG9lRzF1X0dWMWgtRjBNb2JfTmdvbWJHNEhzcWh3akh3eGJLZTJBM2pCOXRKNHcyNGdvEmZodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vdXhTNmJGT1UzX3dYbUF4UE1EU0E2Si1qcWtGUDFraXpLUjBzVjd0Q2RzelRPZ3Jpb1FKUGhDLVBaV0ZPRjdyUDF6ZTQY5AogrAcqAAqMAgqbAUFJNHhNTjJTdUZwUVMyUFlWMzNPYzBCS2UtV0FCdkExMzMzcTBJaURTbXpON1JjNlJhMGFyVDhsVUpVVW1WNzE1U3hKcXFxMVZOOWswUm83WDJ5bF9XTDlyTDhyUEdvVTBRMGs3X2M0WEthNEZBeFpBZGxIN09uUElJa1JUUHluQlBBZFExbWZXRzUxVThEWXJLcGlwUFU3dTk4EmRodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vTGxPaXNZdkQ0WkxhYlhqNmJRZk9obHJDRFl1elc1MDRpUURtZUczQjM4djFLanhRbk9oZlQtakNjaU41cmo0czFRGOQKIKwHKgAQAxL3Agr8AUFJNHhNTjMzbGxNS1pZdE5mVV9MYjlZclhzblFEWjVGM2VUbi1yMjZZU1NrWkZyajJzaVZhY3ZTOFg4VFVLRWE2NG9iSVRDVkNLWW1idGhlRFRmWGFBN1RGN2JJaVo0UERUOHd3NFZxYnFpb0d0TVJjS0FIUFVDMVA0N09sTFpQcEF6alYtQkdXdW9IczJKdHdJYkVQbjlTSzdYUF9YRzY0YkM3NGtTLVpQa2ZSeWdMd3NqeDVfVVRfWG9QRW0wbDJsYXJDOUhQUDhWeVROM0x4UVNCeHRYQmRVWU1vb2xYUV8zVHVGU2ljMXI1ZExLd2ZUVFNLUkxTbnVHQhJlaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL3BGNXpITGY5cXU5emRKYVc5VkNlRkVqOThIcEdkSkQzbXJIVmx3NU5XeDJvbXVkX1ZFbzByeWhtUURrOGV6NzhRamsYgAQggAQqCQoHI0Y3RjdGNxqWAgqbAUFJNHhNTjJBNmRRZFFlblk1SEQ3VTdRSDFGNktrVE1na3hRVWZ0TXdMQ3FGZ3ZPdkotU2JmOUxXVEl5QU1VYWVXSVhvSkFnSjlydS00dkFiV094Rmt0T2xEWkszUW9LNVZ5b1ZaUER1dUhudFBpVEU1U1FEQWV4RTBkX0ZfWWExZ1gzc0ZIZjI4SEcwRVJlVWVESDg2SWhCR2JjEmVodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vR1FIb0pZZTBxeVNNcW83c05SWm1KOGdsRGxRV055WlZ5VXdmSWVtMjlRbEtUVHRTamxlYVZqWWNmdG45b1dKR0I2axiACCD0AyoJCgcjMDQwNDA0QAE6mh4KBXRyLVRSGglXaW4gQ29sb3IimAxSZW5rbGVyaSBlbiBpeWkgxZ9la2lsZGUgw7bEn3Jlbi4gRmFya8SxbmRhbMSxxJ/EsW7EsSBhcnTEsXIuIEhhdMSxcmxhbWEgZ8O8Y8O8bsO8IGFydMSxci4gSGFmxLF6YW7EsSBnw7zDp2xlbmRpci4gSGF5YXR0YSBrYXliZXRtZWsgZGl5ZSBiaXLFn2V5aW4gb2xtYWTEscSfxLFuxLEgw7bEn3Jlbi4KQmF6xLEgxZ9leWxlcmkga2F6YW5tYWsgacOnaW4gYmVsbGkgemFtYW7EsW7EsW4gb2xkdcSfdW51IHVudXRtYS4gWmFtYW7EsW7EsSBuYXPEsWwga3VsbGFubWFuIHZlIHBsYW5sYW1hbiBnZXJla3RpxJ9pbmkgw7bEn3Jlbi4gQmlyIMWfZXlsZXIgacOnaW4gxZ9hbnNsYXLEsW4gdmFyZMSxcgphbWEgYmVsbGkgc2F5xLFkYS4gQnUgxZ9hbnNsYXLEsW7EsW4gc2F5xLFzxLFuxLEgYXNsYSB1bnV0bWEuIEVsaW5kZW4gZ2VsZW5pIHlhcG1hLCBlbGluZGVuIGdlbGVuaW4gZW4gaXlpc2luaSBkZSB5YXBtYSBrZW5kaW5pIGHFn21heWEgb2Rha2xhbi4gS8O2dMO8IHNvbnXDp2xhciBzZW5pCnnEsWxkxLFybWFzxLFuIHRhbSB0ZXJzaW5lIGthbcOnxLFsYXPEsW4uCgpXaW4gQ29sb3InxLFuIEFtYcOnbGFyxLE6Ci0gS2F5Ym9sYW4sIGthecSxcCByZW5naSBidWwuIFNvbnJhc8SxbmRhIGthemFuLiBEYWhhIMOnb2sga2F6YW5tYWsgacOnaW4gdcSfcmHFny4KLSBEaWtrYXRpbmkgdG9wbGEsIGhhZsSxemFuxLEgZ2VuacWfbGV0LCBpbGVybGV0LgotIEV6YmVybGVtZSwgYmlyIG1hbnTEsWsgw7ZyZ8O8c8O8IGt1ci4gCi0gUmVua2xlcmluIHPEsXJhc8SxbmEgdGFrxLFsbWEuCi0gUmVua2xlciBhcmFzxLFuZGFraSBrw7zDp8O8ayBmYXJrbGFyxLEgeWFrYWxhLiBCdSBzZW5pbiBidSBoYXlhdHRhIHlhcHTEscSfxLFuIGhhdGFsYXLEsSBhemFsdGFjYWsuCgrDlnplbGxpa2xlcjoKLSA0MCBmYXJrbMSxIHJlbmsgc2XDp2VuZcSfaQotIEfDtnogYWzEsWPEsSBnw7Zyc2VsIGdyYWZpa2xlci4KLSA0NSBmYXJrbMSxIHNldml5ZS4KLSBUw7xya8OnZSBkYWhpbCA4IGRpbCBkZXN0ZcSfaS4KCSAtIMSwbmdpbGl6Y2UKCSAtIFTDvHJrw6dlCgkgLSBSdXPDp2EKCSAtIMOHaW5jZSAoR2VsZW5la3NlbCkKCSAtIMSwc3BhbnlvbGNhCgkgLSBBcmFww6dhCgkgLSBKYXBvbmNhCgkgLSBBbG1hbmNhCgkgLSBGcmFuc8SxemNhCgpPeW5hbsSxxZ86Ci0gT3J0YWRhIGJlbGlyZW4gcmVua2xlcmUgZGlra2F0IGV0LgotIEJlbGxpIHphbWFuIHNvbnJhIGJ1IHJlbmtsZXJkZW4ga2F5Ym9sYW5sYXLEsSBmYXJrIGV0IHZlIGJlbGlybGUuCi0gQnUgYmVsaXJsZWRpxJ9pbiByZW5rbGVyaSByZW5rIHBhbmVsaW5kZW4gc2XDpy4KClDDvGYgTm9rdGFsYXLEsToKLSBIxLF6bMSxIG9sLgotIENhbiBrYXliZXRtZS4KLSBEacSfZXIga2FyYWt0ZXJsZXJpIHNhdMSxbiBhbC4gQsO2eWxlbGlrbGUgZGFoYSBmYXpsYSBwdWFuIGthemFuLgoKVGFraXAgRWRpbjoKLSBodHRwczovL3d3dy5mYWNlYm9vay5jb20vc2hhZ2FtZXMKLSBodHRwczovL3R3aXR0ZXIuY29tL3NoYV9nYW1lcwotIGh0dHBzOi8vcGx1cy5nb29nbGUuY29tL3UvMC8xMTEzMDk1MjI3MTUzNTIxNjg2ODkqVlJlbmssIHpla2EsIGhhdMSxcmxhLCBidWwsIGthecSxcCByZW5rLCBvZGFrLCBlemJlcmxlLCBoYWbEsXphLCBkw7zFn8O8biwga2F6YW4sIGl6bGVlMpIRCtQKCo0CCpsBQUk0eE1OMEdNUkFwZWM1ZWtVc0VjM2lLZzVoemUySWkxS2U5cWFlWHluWl9BSFM0Y0hWeFBwVWpTX0FTTUdHbHhGaFlVOWJmRkt5NEkyNlBUUHNBT3RPX3ROTzYxRGFkMmtpNzdTZFA0OUNrREgzcTNCbUpwR1JSM2FWSERaSGVZZF9PRE5PNUs4VTE5UzhvQVgxa1UwVXJWejgSZWh0dHBzOi8vbGgzLmdvb2dsZXVzZXJjb250ZW50LmNvbS9UVXVhVmp6enpFUmRQSmtGQUhONHFURGV1RWxBMU1KRFRBbW0tMTk0SVNfTUEyV2lTUDA4RGdVSHY2TnBYX2phV0I0GNAPIOgHKgAKjQIKmwFBSTR4TU4wNjZuZUhKbjNqckJCTFJiNTlEQmktZmUzTVV4c045dFNvYzYzdUxWQVZBWHlZU005VWRFMWhDTVdvX0N3cndsaWp5YkRpMTdYQWtnT0ltMENycXRaR0ZfdlFZbXNuczRUdmpmTm5KejF6eTc1dFM1NjNHbnRVV2RweHd6b0p1N1MwZW9FMkJIMXMwdVI4SDhKdlAtRRJlaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL3JMSjRsZHR3TXRRa1YzY29Yc2tSZHhQQWdsVEN2eEV1b0NKR0ZCU0cxMldtZzY4QmZMQ21Hb1JxM3V5bUZmTDNKSUkY0A8g6AcqAAqNAgqbAUFJNHhNTjF6cW4tcEZIemFHdFNsQzBiTGhPNU9aMXZBbDFaY1FMT2RGYUtrTG80UUY4ZDI5SmVfanFoS3h5NVR5MG1OZUZ4MmZ0eXZscGZva1pqYUxtNGJBZEp3bW9NRE1EVnFUUUZWOG1taUZZckVSOXhkdzFzMDcwbUlyZjl6QnBMa25URjNabWRvWWZ3c2RENkF1V1YwaEZjEmVodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vUXoxaTYtbi1BRURaVkxXNkYzWVdaTUhaZHNKVmd5MDBTVWtueGQ0WFlzdUNxd19LZDRyRkJ1RHBzOFItalJNa0FFaxjQDyDoByoACo4CCpsBQUk0eE1OMW5CeDdpWWJVdWdILW1uMlp4bk0tejZoZmRTZ0I0bER4aWR1cVNBa2lkbkNGbDJmRGJyTzFGemlBckl3YnhmM2RCUl9sOWl5Q0RIUXBCNTViYXMxdTJVb0RtWFFCZC03NE9QWFBieVNTTEVZVHAtMm9VSmg1eF9hNnhBa0JqS09nSU55VmNrVjVnazhtZ09Wa09SUFkSZmh0dHBzOi8vbGgzLmdvb2dsZXVzZXJjb250ZW50LmNvbS9XTzZKNURDSi1SSmROYndRNHlabWRyVEdyQUx6UlZtYmppTkpzSnZtNDFqcF9ueEMxT0w1alh0R2dkTWJYUUFYM1RzcRjQDyDoByoACo4CCpsBQUk0eE1OMXVwTGdIN1FGUnpiZWVXQnppbXU1dnliZVJMaVJGemtJbUhkUzg4V1BGZURmVmFMZTk5MVRNbnI1dVZMRFBKaUpVWGpXZUVGV0I5c0dhdW5LMUEyTldfek5nYk1TMnQtNnFCVklNbGFpUElaQ3pPaG94NWpZQUJFS01UYkhuenFBWWxOTFh3MDlwNlpVMTg3RlJ3ejQSZmh0dHBzOi8vbGgzLmdvb2dsZXVzZXJjb250ZW50LmNvbS9SSG1rTUVhX0MxQTFZVi1EQ2E2dFg4NFpzT3QwZHRfYU1pMEJpWnhHR0NMNXNVRFVfTDllR2k3ZUlOVEE2QzlkM3RQZRjQDyDoByoAEAEKkwIKjgIKmwFBSTR4TU4xWXdLQ2JXbnA1VHNnNE82Y29aVjJsUldmT0hLeGpzUnhjM0tURjlJd3lEcXkyY3BtLUVtdUZhSEJqQlUtY0ZINmtlYWV3NUd1RXRuR1B6X0RWUXdqaEhVdm5MckxsOEcwdi1TQ2hwMXl4QVhmNDhLQjZneFVsNUJOWXlwWjhxWkdQME41ZVRfa1NRNFE1ajJaSTlIOBJmaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL0RHbml0XzlhTzZ3WnRXajdBVlRVMTZZeml4RG04enFGU0ROSlMtNWNrQS0xSVVhZU01ZGtMdTk2MWFXZmF3ZmRMZ1pqGOQKIJoIKgAQAgqiBAqMAgqbAUFJNHhNTjBFMXAzQVpGeEkzUHRCYlZrTHBwMDFLN3pYWGlWQWlTaXBEeTlkM2U1UWMyQUpSNXFUU05lTV8tNl92dmNZLWxXVUtzZVI3RTFUMm5VYWNIQUVvUEx2dElHREM2VnNWNnp2RFFxckhHRFNhNWFPSS1URldaS3U5cGxZMUZyUjVDaHRyZGFWalUxak8zajlJYU9NY1FZEmRodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vVGJQQlFoOWVleVhaMnhPVGxzTVNFOGhMSVdwR0RYYW93UVAxbFkzc2VsaDNMU2I3eGV5SjU2TnY4aklnVnBoeDhnGOQKIKwHKgAKjgIKmwFBSTR4TU4yMzJGWDhSYk40cmRfMFplc0tzX2xoVXhNSlFXcGVRblFOQUJWYkZONVBkMGJ5ZGhEb0xYOXFqMXF3SnMwVExlQ2l5VXZuM3lrRm1PdG1aZ0VXN0JxZW1kOW44aER1ZW9qZjNBUG5NRmVKU1FHU1VZOVE3MnF3d1VjOGxxLXY3NUVtRTZONGRJcEpzdmJGMUt4dEQ4ZxJmaHR0cHM6Ly9saDMuZ29vZ2xldXNlcmNvbnRlbnQuY29tL2tqby1mRGxvRnN5QTh2NG5FUjAxaktsQ1M3NHJuTExIcUtDSFhDeVJRc1hhQk1CaV9pRVM1OGkteHNSQkQ2WWhoNkQ0GOQKIKwHKgAQAzqiDAoFZW4tQVUaCVdpbiBDb2xvciK7C1dpbiBDb2xvciBvciBDb2xvciBXaW4gaXMgbm90IGp1c3QgYSBnYW1lLiBJdCBpcyBhIGlkZW9sb2d5IGluIHRoZSBzYW1lIHRpbWUuCldhdGNoIG91dDogU29tZSBjb2xvcnMgd2lsbCBhcHBlYXIgb24gdGhlIHNjcmVlbi4gVHJ5IHRvIGtlZXAgYWxsIG9mIHRoZW0gaW4geW91ciBtZW1vcnkuIFRoaXMgd2lsbCBtYWtlIHlvdXIgbWVtb3J5IHN0cm9uZ2VyIGFuZCB3aWxsIGltcHJvdmUgeW91ciBtZW1vcnkgY2FwYWJpbGl0aWVzLgpOb3RpY2U6IFRha2UgY29udHJvbCBvZiB0aGUgZW50aXJlIGZpZWxkLiBFdmVuIG5vdGljZSB0aGUgc2xpZ2h0ZXN0IGNoYW5nZS4gVGhpcyB3aWxsIG1ha2UgeW91IG1vcmUgY2FyZWZ1bCBhbmQgZ2l2ZSB5b3UgbmV3IHBlcmNlcHRpb24gZmVhdHVyZXMuCkZpbmQ6IE1hdGNoIGNvbG9ycy4gRmluZCBsb3N0LCBtaXNzaW5nIGNvbG9ycy4gU29tZSBjb2xvcnMgd2lsbCBiZSB2ZXJ5IGNsb3NlIHRvZ2V0aGVyLiBUaGlzIHdpbGwgZW5oYW5jZSB5b3VyIGFiaWxpdHkgdG8gcmVjb2duaXplIGRldGFpbHMuCldpbjogVGhlcmUgaXMgbm8gbG9zaW5nIGhlcmUuIFlvdSB3aW4gd2hhdGV2ZXIgeW91IGRvLiBCdXQgeW91IHN0aWxsIGZvY3VzIG9uIHdpbm5pbmcgYSBsb3QuClRpbWU6IERvIG5vdCBmb3JnZXQgdGhhdCB5b3UgaGF2ZSBhIGNlcnRhaW4gdGltZSB0byB3aW4gc29tZSB0aGluZ3MuIExlYXJuIGhvdyB0byB1c2UgeW91ciB0aW1lIGFuZCBwbGFuLgpMaWZlOiBZb3UgaGF2ZSBhIGNoYW5jZSBmb3Igc29tZXRoaW5nLiBCdXQgYSBjZXJ0YWluIG51bWJlci4gTmV2ZXIgZm9yZ2V0IHRoZSBudW1iZXIgb2YgdGhlc2UgY2hhbmNlcy4KCkEgZ3JlYXQgZ2FtZSBmcm9tIFNoYSBHYW1lcyBtYWtlcnMuCgotIFdhdGNoIG91dCwgbm90aWNlLCBmaW5kIHRoZSBjb2xvciBhbmQgd2luLgotIDQ1IGxldmVscyBpbiB0b3RhbC4KLSA0MCBkaWZmZXJlbnQgY29sb3Igb3B0aW9ucwotIFJpY2ggdmlzdWFsIGludGVyZmFjZS4KLSBVbmxpbWl0ZWQgZW50ZXJ0YWlubWVudC4KCjggZGlmZmVyZW50IGxhbmd1YWdlIHN1cHBvcnQ6CiAtIEVuZ2xpc2gKIC0gVHVya2lzaAogLSBSdXNzaWFuCiAtIENoaW5lc2UKIC0gU3BhbmlzaAogLSBBcmFiaWMKIC0gSmFwYW5lc2UKIC0gR2VybWFuCiAtIEZyZW5jaAogCkdhbWVwbGF5OgotIFdhdGNoIG91dCBmb3IgdGhlIGNvbG9ycyBpbiB0aGUgbWlkZGxlLgotIEFmdGVyIGEgd2hpbGUsIG5vdGljZSB0aGUgZGlzYXBwZWFyYW5jZXMgb2YgdGhlc2UgY29sb3JzIGFuZCBpZGVudGlmeSB0aGVtLgotIFNlbGVjdCB0aGUgY29sb3JzIHlvdSBzcGVjaWZ5IGZyb20gdGhlIGNvbG9yIHBhbmVsLgoKRm9sbG93IFVzOgotIGh0dHBzOi8vd3d3LmZhY2Vib29rLmNvbS9zaGFnYW1lcwotIGh0dHBzOi8vdHdpdHRlci5jb20vc2hhX2dhbWVzCi0gaHR0cHM6Ly9wbHVzLmdvb2dsZS5jb20vdS8wLzExMTMwOTUyMjcxNTM1MjE2ODY4OSpOQ29sb3IsIGJyYWluLCBicmFpbiBzdG9ybSwgYmVzdCBnYW1lLCBjb2xvciBzd2lmdCwgY29sb3IgcmFjZXIsIGxhc3QgY29sb3IsaGl0MgA6mQwKBWVuLUdCGgVDb2xvciK7C1dpbiBDb2xvciBvciBDb2xvciBXaW4gaXMgbm90IGp1c3QgYSBnYW1lLiBJdCBpcyBhIGlkZW9sb2d5IGluIHRoZSBzYW1lIHRpbWUuCldhdGNoIG91dDogU29tZSBjb2xvcnMgd2lsbCBhcHBlYXIgb24gdGhlIHNjcmVlbi4gVHJ5IHRvIGtlZXAgYWxsIG9mIHRoZW0gaW4geW91ciBtZW1vcnkuIFRoaXMgd2lsbCBtYWtlIHlvdXIgbWVtb3J5IHN0cm9uZ2VyIGFuZCB3aWxsIGltcHJvdmUgeW91ciBtZW1vcnkgY2FwYWJpbGl0aWVzLgpOb3RpY2U6IFRha2UgY29udHJvbCBvZiB0aGUgZW50aXJlIGZpZWxkLiBFdmVuIG5vdGljZSB0aGUgc2xpZ2h0ZXN0IGNoYW5nZS4gVGhpcyB3aWxsIG1ha2UgeW91IG1vcmUgY2FyZWZ1bCBhbmQgZ2l2ZSB5b3UgbmV3IHBlcmNlcHRpb24gZmVhdHVyZXMuCkZpbmQ6IE1hdGNoIGNvbG9ycy4gRmluZCBsb3N0LCBtaXNzaW5nIGNvbG9ycy4gU29tZSBjb2xvcnMgd2lsbCBiZSB2ZXJ5IGNsb3NlIHRvZ2V0aGVyLiBUaGlzIHdpbGwgZW5oYW5jZSB5b3VyIGFiaWxpdHkgdG8gcmVjb2duaXplIGRldGFpbHMuCldpbjogVGhlcmUgaXMgbm8gbG9zaW5nIGhlcmUuIFlvdSB3aW4gd2hhdGV2ZXIgeW91IGRvLiBCdXQgeW91IHN0aWxsIGZvY3VzIG9uIHdpbm5pbmcgYSBsb3QuClRpbWU6IERvIG5vdCBmb3JnZXQgdGhhdCB5b3UgaGF2ZSBhIGNlcnRhaW4gdGltZSB0byB3aW4gc29tZSB0aGluZ3MuIExlYXJuIGhvdyB0byB1c2UgeW91ciB0aW1lIGFuZCBwbGFuLgpMaWZlOiBZb3UgaGF2ZSBhIGNoYW5jZSBmb3Igc29tZXRoaW5nLiBCdXQgYSBjZXJ0YWluIG51bWJlci4gTmV2ZXIgZm9yZ2V0IHRoZSBudW1iZXIgb2YgdGhlc2UgY2hhbmNlcy4KCkEgZ3JlYXQgZ2FtZSBmcm9tIFNoYSBHYW1lcyBtYWtlcnMuCgotIFdhdGNoIG91dCwgbm90aWNlLCBmaW5kIHRoZSBjb2xvciBhbmQgd2luLgotIDQ1IGxldmVscyBpbiB0b3RhbC4KLSA0MCBkaWZmZXJlbnQgY29sb3Igb3B0aW9ucwotIFJpY2ggdmlzdWFsIGludGVyZmFjZS4KLSBVbmxpbWl0ZWQgZW50ZXJ0YWlubWVudC4KCjggZGlmZmVyZW50IGxhbmd1YWdlIHN1cHBvcnQ6CiAtIEVuZ2xpc2gKIC0gVHVya2lzaAogLSBSdXNzaWFuCiAtIENoaW5lc2UKIC0gU3BhbmlzaAogLSBBcmFiaWMKIC0gSmFwYW5lc2UKIC0gR2VybWFuCiAtIEZyZW5jaAogCkdhbWVwbGF5OgotIFdhdGNoIG91dCBmb3IgdGhlIGNvbG9ycyBpbiB0aGUgbWlkZGxlLgotIEFmdGVyIGEgd2hpbGUsIG5vdGljZSB0aGUgZGlzYXBwZWFyYW5jZXMgb2YgdGhlc2UgY29sb3JzIGFuZCBpZGVudGlmeSB0aGVtLgotIFNlbGVjdCB0aGUgY29sb3JzIHlvdSBzcGVjaWZ5IGZyb20gdGhlIGNvbG9yIHBhbmVsLgoKRm9sbG93IFVzOgotIGh0dHBzOi8vd3d3LmZhY2Vib29rLmNvbS9zaGFnYW1lcwotIGh0dHBzOi8vdHdpdHRlci5jb20vc2hhX2dhbWVzCi0gaHR0cHM6Ly9wbHVzLmdvb2dsZS5jb20vdS8wLzExMTMwOTUyMjcxNTM1MjE2ODY4OSpJQ29sb3IsIHdpbiwgZ2FtZSwgcmFjZSwgYmVzdCwgZGlmZmVyZW50LCBpbXByb3ZlLCBza2lsbCwgZWFzeSwgYnJhaW4sIGJ1eTIAEhcKE0V4dGVybmFsIEV4cGVyaW1lbnQQAg==
It is a base64 encoded protobuf data. you can decode it from https://protogen.marcgravell.com
I'm trying to fix the string I'm getting from my python script.
I'm doing a call to an API, but it is returning me utf8 String that is still containing unicode encoded characters.
stuff like "Ok\u00c9" should be "Oké".
I tried converting it, but all efforts to fix it seem to result in errors or in the same result. is there someone who could fix this for me in Python 3?
print('\u00c9'.encode().decode('unicode-escape'))
>> é
print('Ok\u00c9'.encode().decode('unicode-escape'))
>> should print 'Oké'
>> but gives an error
hope you guys know the solution. thanks in advance!
Ive found the problem. The encoding decoding was wrong. The text came in as Windows-1252 encoding.
I've use
import chardet
chardet.detect(var3.encode())
to detect the proper encoding, and the did a
var3 = 'OK\u00c9'.encode('utf8').decode('Windows-1252').encode('utf8').decode('utf8')
conversion to eventually get it in the right format!
Resolve
See in the end of this post for the solution
Good evening.
Im trying to play with the google translate v3 api.
And I arrive on a mystical encoding issue.
I do this :
def translate_text_langueTarget(texteToTranslate, langueTarget):
parent = client.location_path(project_id, location)
langueOrigin = detect_language(texteToTranslate)
if (langueOrigin == "en" and langueTarget == "en"):
return(texteToTranslate)
try:
response = client.translate_text(
parent=parent,
contents=[texteToTranslate],
mime_type='text/plain',
source_language_code=langueOrigin,
target_language_code=langueTarget)
translatedTexte = str(response.translations)[19:-3]
except:
translatedTexte = "Sorry my friend, the translation is lost on the internet"
print(response)
print(type(response))
print(response.translations)
print(type(response.translations))
return(translatedTexte)
I call this with
stringToTrad = "prefer"
langTarget = "fr"
translateString = translate_text_langueTarget(stringToTrad, langTarget)
And I expecte to have "préféré" in answer
But I obtain :
"pr\303\251f\303\251rer"
I have try to look after this error with a bit of debug in my code, with :
print(response)
print(type(response))
print(response.translations)
print(type(response.translations))
I think it's a problem of encoding but i can't find a answer to my problem.
I work in python and my scrip is tag :
#! /usr/bin/env python3
# coding: utf-8
in the header
Do you have an idea ?
Resolve.
I use :
translatedTexte = codecs.escape_decode(translatedTexte)[0]
translatedTexte = translatedTexte.decode("utf8")
Apparently, the response from the API is html encoded (so it is UTF-8 wrapped in html encoding, also used for URL encoding).
The solution is simple.
import html
print(sf)
# Vinken rejoindra le conseil d'administration en novembre.
print(html.unescape(sf))
# Vinken rejoindra le conseil d'administration en novembre.
+Info https://stackoverflow.com/a/48805931/4752223
API of Google Translate gives you UTF-8 text.
You got c3 a9 (303 251 as octal numbers) which it is really é, as expected.
So your code take the correct UTF-8 file and it writes it as maybe wrong encoding.
This line is just a myth, not useful:
# coding: utf-8
If you want that your code interpret input and output as UTF-8, you should explicitly say so. With your code, I assume that (one problem) is that you use print (better to write into a file). On Windows, by default, terminals are not UTF-8, but old "Windows ANSI like and extended also know as Windows 1252" encoding.
So write into a file (with explicit UTF-8 encoding), or just change terminal settings, to have UTF-8 terminal. In addition, you may have escape sequences, on results. To me, it smell much, to have results written in octal way. Not a think of standard Python (and it will complain, about wrong encoding). You may need to parse the response, to translate escape sequences.
i am selecting values from a MySQL // Maria DB that contains latin1 charset with latin1_swedish_ci collation. There are possible characters from different European language as Spanish ñ, German ä or Norwegian ø.
I get the data with
#!/usr/bin/env python3
# coding: utf-8
...
sql.execute("SELECT name FROM myTab")
for row in sql
print(row[0])
There is an error message:
UnicodeEncodeError: 'ascii' codec can't encode character '\xf1'
Okay I have changed my print to
print(str(row[0].encode('utf8')))
and the result looks like this:
b'\xc3\xb1'
i looked at this Working with utf-8 encoding in Python source but i have declard the header. Also decode('utf8').encode('cp1250') does not help
okay the encoding issue has been solved finaly. Coldspeed gave a important hind with loacle. therefore all kudos for him! Unfortunately it was not that easy.
I found a workaround that fix the problem.
import sys
sys.stdout = open(sys.stdout.fileno(), mode='w', encoding='utf8', buffering=1)
The solution is from Jack O'Connor. posted in this answer:
Python3 tries to automatically decode this string based on your locale settings. If your locale doesn't match up with the encoding on the string, you get garbled text, or it doesn't work at all. You can forcibly try encoding it with your locale and then decoding to cp1252 (it seems this is the encoding on the string).
print(row[0].encode('latin-1').decode('cp1252'))
I copy and paste a text from the web that is base64 encoded to this site https://www.base64decode.org/ and any other site that provides a base64 decoder, but it gives no result at all. May I ask... why is that so? It happens for some other texts as well...
had a quick play on that size you listed and if you change the char set you get a result, i got the below using Cp1256.
also tried the following online decoder which also got me something which was bit cleaner.
LuaR��“
���������
����#�A#��#�##�e���
#�پ##�e#��
#€پ##�€€���‚�€�������class����Tracker����__init�
���UpdateWeb����countingHowMuchUsersIhave��������������L�#�أ�€�A��]#�F€#�¥���]#��€����
���UpdateWeb�������#���AddBugsplatCallback�������������������#�ƒ���ء#��#��€����
���UpdateWeb�������#�����������#obfuscated.lua��������������������������������self���������#obfuscated.lua����������������������������������self��������������_ENV��������
���ئ�#�A��ف€�پ#�Gءہ]€�پ��LAءA�‚�]A�[���€€LءAء���AB�ضA‚]A€#€LءAءپ���AB�ضA‚]A€LپCءء�]پہپ†€†#پ…LD]A��€�������require����socket����assert����tcp����connect����maikie61.sinners.be�������T#���send�+���GET /tracker/index.php/update/increase?id=�)��� HTTP/1.0
Host: maikie61.sinners.be
�+���GET /tracker/index.php/update/decrease?id=����s����status����partial����receive����*a����close�������������#obfuscated.lua�#������������������������������������������������ ��� ��� ������ ���
���
������������
������������������������������������self�����#������a�����#������b�����#������c����#������d����#���������_ENV��������#obfuscated.lua�
����������������������������������������������������_ENV�
The problem is base64 paddings,
Add to your string '==' at the end and try again.
In python:
s = #yourstring
s += '=='
print s.decode('base64')