I have an encrypted zip file on AWS S3 with one xml file inside. I am streaming that to my node.js heroku app and I need to unzip (with password) and stream the xml file through my SAX parser. I've got everything downpat with my SAX parser. The problem is getting the XML file out of the ZIP file using the password.
There seems to be plenty of decent libraries for node that allows you to unzip files. However, none of them support unzipping a zip file that is AES encrypted or encrypted period. At least, not to my find and I've spent a few hours researching this.
I would prefer to stream the zipfile and contents for sake of speed. Right now looks my only option I can find is to unzip the file via command line execution through node. I would not prefer to do this mainly because I can't find a way to stream the file via command line.
Related
I have successfully uploaded some audio files via Nodejs to AWS, the file url is also returned from my function. I plan to save this url in MongoDB Atlas as a reference to the original file but before doing that, I tried to play the file (from the url) in my mobile app and it won't play.
The file is in .m4a format. How do I get this to work in any audio player for mobile and web? I'm using flutter for both. I don't want to do piping, chunking and streaming manually as this is just a dummy test of the system. The original files to be used in the app will be much larger.
Here's the file url https://empty-bouquet.s3.af-south-1.amazonaws.com/Dax+-Dear+God.m4a.
Thanks
.m4a audios aren't natively streamed from S3, but after a test I can verify that .mp3 files are. Most browsers will recognize that filetype and render a built-in player for you.
You can convert from one format to another using a lot of free tools. I used Audacity.
And yes, you need to make at least the file public. Or if you're going to do this a lot I would recommend making a bucket policy that makes everything public, no matter what you throw in there.
I am processing a video file using ffmpeg, in AWS lambda. My file size is 1gb. I don't want to store the processed file in /tmp folder (or efs).
Is there a way I can directly download the output file to the user's desktop, from AWS lambda?
I followed the guidance in this wiki page to create an application package for my Azure Batch pool, but now my nodes are stuck in an unusable state because it fails to unzip. I can't find anything in the documentation that talks about what kind of compressed file is acceptable here, other than "a zip file".
I have a collection of database files used for some genomic sequencing tools that I have stored in a folder structure, which I created a compressed archive with using tar -zvcf and gave a .zip extension to. That did not work, so I tried uploading the same file with a .tar.gz extension and it also failed.
The Batch Node is running the CentOS image Azure Batch recommends for container applications, and my startup task is not running in the context of the container.
Can anyone point me to documentation or personal experience that helps clarify what kind of files can be used for this? Thank you in advance!
Yes, you are correct, but let me emphasise on the confusion, tar is the different compress archive file format then zip i.e. more detail here: What is the difference between tar and zip? it is mentioned many times in the documentation you mentioned along with
Batch App Package feature only support *.zip format and hence changing file extension from *.tar to *.zip is not the right way as they are 2 different way they get compressed et. al.
Extra docs:
https://azure.microsoft.com/en-au/blog/application-packages-and-task-dependencies-now-available-on-azure-batch/
https://kb.winzip.com/help/winzip/AboutZIPsAndOtherArchives_4.htm
Thanks and hope it helps.
I've recorded an interview as an .mp3 file and would like to send this file to someone over email. Because the contents of the interview needs to remain confidential, I need to find some way to encrypt it.
I tried zipping an audio file with the 7-zip program, and encrypting the zipped package, but when I tested this by sending the audio file to two friends (along with the password), one person got the message "an error occurred" and another got the message "unable to open this file."
I found this website, which seems promising, but it is way too technical for me. Does anyone know of a simple way to encrypt audio files?
7-zip can encrypt a file while compressing, not after. Just add a password while you're making the .7z file. (Note that mp3 files won't compress much, if at all. You're just using 7-zip for its encryption).
You could also use PGP, if the person you're sending the file to has given you (or registered) a public key. PGP is a higher level of security than most zip programs.
Is there anyway we can detect if file writing is complete before start processing file? What i mean is, we have java program written in spring integration and it polls .zip file, as soon as it sees that file, it picks up and start processing it. But in case of large .zip files, before it writes complete file,it is picking up that file and causing an issue.
Does anyone know how to detect if file write is still in progress?