When cron launches a command under my user ID, where in the file system does it actually launch it?
Let's say I have this python script:
import sys
filepath = sys.argv[1]
try:
fp= open(filepath)
... stuff ...
except:
print ("File not found.")
And I call the script in my crontab:
0 2 * * /home/me/scripts/bla.py filename
The file "filename" lives in /home/me/scripts. This gives me the 'File not found' message. So obviously my script got launched in some other place than /home/me/scripts. But where? I can put absolute paths into the crontab, but that's lots of clutter when multiple arguments are given. What's the best trick?
You don't say what system you're using, but on every system I've ever used cron launches jobs with their current working directory set to the user's home directory. Some systems will document that behaviour in their man pages for cron or crontab, but if they don't (or if you want to be certain) then it's easy to check the situation for your system. Just add this into your crontab:
* * * * * /bin/pwd > $HOME/cron-pwd.txt
and wait for a minute or so for the cron-pwd.txt file to appear in your home directory. And, obviously, remove that line from your crontab after you've read the file.
This means that your crontab command line can use pathnames relative to your home directory:
0 2 * * * scripts/bla.py scripts/filename
or you can build absolute paths by using the $HOME environment variable:
0 2 * * * $HOME/scripts/bla.py $HOME/scripts/filename
Alternatively, if writing out paths repeatedly isn't convenient then you can have your job change its own working directory before it starts running the program that will do the real work:
0 2 * * * cd $HOME/scripts ; ./bla.py filename
Some implementations of cron have enhancements that can affect the initial working directory, such as letting you specify a HOME environment variable that is different from your actual home directory. I don't recommend using that feature to get your job launched in a specific directory unless you're very sure of what you're doing, because setting a non-standard $HOME can have unexpected side effects on commands that get executed as part of the job.
BTW, your question has only 0 2 * * at the start of the crontab line, missing a field. I assume that's just a copy-paste error. Also, it doesn't invoke Python to run the script. I assume that's also either a copy-paste error or your real script has a #! line that invokes your Python interpreter.
Related
I want to use cron for execute a script periodically. I want to try a simple script first but it does not work.
This is my script (scritp.sh) which permission are 700:
#!/bin/sh
clear
echo "Hello!"
mkdir Hello
And this is the crontab file when I edit it with the command crontab -e:
SHELL=/bin/sh
* * * * * /home/padro/Documents/script.sh
EDIT:
I have that script on /home/padro/Documents folder. What I do after it is execute the command crontab -e for modify the cron file. In this file I put the shell that I want SHELL=/bin/sh and also the cron schedule expression * * * * * /home/padro/Documents/script.sh. This schedule teorically run the script every minute. Finally I save the file and when a minute passes I can't see the echo of the script on the terminal.
EDIT2:
I have added mkdir hello, because I don't know if the echo of the script is shown on the terminal. But the hello directory is never created.
Any output generated by a program called from cron will by default be emailed to the user owning the crontab (assuming local delivery of mail messages is possible). So I'd suggest that you look in your inbox on the local machine.
To save the output into a file, use a redirection in the crontab, or arrange for the script to write its output to a file.
Jobs started by cron does not run with a terminal, so you should not expect to see your terminal being cleared every minute by running this script through cron.
The Hello folder should have been created in the working directory used by the script (possibly your home directory). To make absolutely sure you know where the script's working directory is, use cd in the script to move to the correct location.
I do not have enough reputation to add comment.
My humble comment would be.
Is the cron file you mentioned via root?
cos chmod 700 a file would be only be executed by owner.
If you are using redhat linux, the user account you use on the first log in is user rights NOT root.
Reference link to a cheat sheet.
su - root
system will prompt root password
crontab -e
* * * * * /home/padro/Documents/script.sh
You can even run a test script, which I did encounter the similar situation as you when I first learnt scripting into your crontab-
* * * * * date > export/home/padro/Documents/testing.txt
If you could, restart the server.
Check if your directory is correct using the command
pwd in linux/unix.
I hope my comment based on my recent learning have helped you.
Edit 1: Remove clear in your script. Thanks...
Edit 2: I believe your Hello folder is created at the core of the root folder try looking for it... or the home directory of the user...
I have a bash script that I want to be executed every 15 minutes, so I added this line to my crontab:
7,22,37,52 * * * * /path/to/my/script.sh
I've checked the directory path to be correct and the script runs correctly if I just run /path/to/my/script.sh manually from any directory. I have this bang line in my script:
#!/usr/bin/env bash
My script also references other scripts in the same directory as it, and I have run chmod +x on all scripts that are needed. I set the MAILTO to my email address and I was getting some Cron Daemon emails when I changed the line in my crontab to:
7,22,37,52 * * * * sh /path/to/my/script.sh
But I never received emails upon using
7,22,37,52 * * * * /path/to/my/script.sh
or
7,22,37,52 * * * * bash /path/to/my/script.sh
I made sure cron is running and I've also tried redirecting the output of my script to a log file, which is also only written in when I include the sh. However, if I run sh /path/to/my/script.sh from the home directory, it does not work. The only ways my script actually runs is if (from any directory) I call /path/to/my/script.sh or bash /path/to/my/script.sh. I'm pretty new to writing bash scripts so any help is very welcome.
#pvas The cron user environment should be treated with extra special care. The assumption that most users have is that they will have access to paths, directories, permissions etc. This is far from the case. Cron runs in a minimal environment and you must set up EVERYTHING - Paths, Permissions and the location where the scripts are running from.
1) I set up the environment myself.
2) I use fully expanded paths in my crontabs.
3) I make sure any directories that need to be read have read permissions.
4) I make sure that my password does not expire because that will block cron when it does.
5) Make sure underlying scripts are explicitly invoked (by Perl, Bash, Python whatever).
6) Pipe the command on the cron line to a LOG file (even better a log file with a TIMESTAMP).
Fix these things and then try again. Cron is particular, you need to set up everything.
For example:
#SETUP ENVIRONMENT
SHELL=/bin/bash
source /home/userfoo/.bash_profile
#RUN THE SCRIPT everyday at 11:50pm (23:50)
50 23 * * * userfoo /home/userfoo/script.sh >> LOGFILE.txt
<<
Crontab entries should have the following format
m h dom mon dow command
which confirms that your entry below
7,22,37,52 * * * * /path/to/my/script.sh
is correct. Having said that, you must close the crontab editor(:wq) for the changes to come to effect.
It is suggested you go through [ this ] cross site post which portrays the possible issues with cron jobs.
More about hashbang [ here ].
I have my php script file in /var/www/html/dbsync/index.php. When cd /var/www/html/dbsync/ and run php index.php it works perfectly.
I want to call PHP file through sh file, the location of SH file is as below
/var/www/html/dbsync/dbsync.sh
This is the content of the dbsync.sh file is:
/usr/bin/php /var/www/html/dbsync/index.php >> /var/www/html/dbsync/myscript.log 2>&1 -q -f
When I cd /var/www/html/dbsync/ and run ./dbsync.sh it works perfectly as well.
Now if I set up crontab as below:
1 * * * * /var/www/html/dbsync/dbsync.sh /var/www/html/dbsync
However, this crontab is not working as expected.
What can be wrong?
As seen in comments, the problem is that you are not defining what program should be used to execute the script. Take into account that a cronjob is executed in a tiny environment; there, not much can be assumed. This is why we define full paths, etc.
So you need to say something like:
1 * * * * /bin/sh /var/www/html/dbsync/dbsync.sh /var/www/html/dbsync
# ^^^^^^^
/bin/sh being the binary you want to use to execute the script.
Otherwise, you can set execution permissions to the script and add a shell-script header telling it what interpreter to use:
#!/bin/sh
If you do this, adding the path of the binary is not necessary.
From Troubleshooting common issues with cron jobs:
Using relative paths. If your cron job is executing a script of some
kind, you must be sure to use only absolute paths inside that script.
For example, if your script is located at /path/to/script.phpand
you're trying to open a file called file.php in the same directory,
you cannot use a relative path such as fopen(file.php). The file must
be called from its absolute path, like this: fopen(/path/to/file.php).
This is because cron jobs do not necessarily run from the directory in
which the script is located, so all paths must be called specifically.
Also, I understand you want to run this every minute. If so, 1 * * * * won't do. Intead, it will run at every 1st minute past every hour. So if you want to run it every minute, say * * * * *.
It is important to understand "login shell" and "interactive shell" what they means.
login shell: is briefly when you sign in with ssh session and get a terminal window where you can enter shell commands. After login the system executes some files(.bashrc) and sets some environment variables such as the PATH variable for you.
interactive shell :After login on a system, you can startup manually shell terminal(s). The system executes some profile file assigned to your account (.bash_profile, .bash_login,.profile). This files also sets some environment variables and initialize PATH variable for your manually opened shell session.
By OS started shell scripts and cron jobs does not fit in above mentioned way for starting a shell. Therefore no any system scripts(.bashrc) or user profiles are executed. This means our PATH variable is not initialized. Shell commands could not found because PATH variable does not point to right places.
This explains why your script runs successfully if you start it manually but fails when you start it via crontab.
Solution-1:
Use absolute path of every shell command instead of only the command name used in your script file(s).
instead of "awk" use "/usr/bin/awk"
instead of "sed" use "/bin/sed"
Solution-2: Initialize environment variables and especially the PATH variable before executing shell scripts!
method 1, add this header in your dbsync.sh:
#!/bin/bash -l
method 2, add bash -l in your cron file:
1 * * * * bash -l /var/www/html/dbsync/dbsync.sh /var/www/html/dbsync
I have an issue related to cron.
Suppose in a shell script,i'm running a query and the out put is getting stored to a temporary file. What is the location of that temporary file? and how can i delete in the shell script itself?
If a command cron is running has output (e.g. status reports, or
errors), cron will email the output to whoever is specified in the
MAILTO variable. If no one if specified, then the output will be
mailed to the owner of the process that produced the output.
From here
output.txt will end up in the directory the cron starts your command with. Unfortunately, the POSIX crontab specification does not seem to specify what that directory is. Neither could I find anything on that in the man pages on my system.
On my system cron will use the home directory of the user it runs the command as. If you don't find output.txt there on your system, you can tease the directory out of cron by temporarily adding a line like the following to the crontab:
For user crontabs:
* * * * * pwd >>/tmp/cronpwd
For the system crontab (replace user by the name of the user that ran the original command):
* * * * * user pwd >>/tmp/cronpwd
Then wait a minute, and the file /tmp/cronpwd should appear, containing the name of the current directory of cron-commands. Don't forget to remove the extra line from the crontab again!
Whatever the directory is, check that it is actually writable by the user running the script. If it isn't then the output is lost and there is no way to get it back.
Note that it is probably a good idea to simply make the command independent of the current working directory, either by specifying absolute paths or by explicitly changing the current directory at the beginning of the command:
5 0 * * * /path/to/your/script.sh > /where/it/should/go/output.txt
5 0 * * * cd /where/it/should/go && /path/to/your/script.sh > output.txt
(That example is a user's crontab, not the system crontab.)
I'm running Ubuntu x64 14.04 and have a cron setup to run a shell script.
0 0 * * * sh root/delete.sh
It should run once a day at midnight. According to my logs, it ran once and then never ran again the next night.
Am I missing something really obvious?
It's hard to tell exactly what you're trying to do, but I can tell you what that command will actually (try to) do.
0 0 * * * sh root/delete.sh
Cron jobs run with the working directory set to the user's home directory. This command will run sh (which resolves to /bin/sh) passing it the string root/delete.sh as an argument. /bin/sh will interpret that as a file name; since it doesn't start with a /, it's interpreted relative to the current directory.
So if you have an executable script in $HOME/root/delete.sh, that line should execute it every night at midnight.
For clarity, you should probably (a) use an absolute pathname, and (b) make sure the script itself has a proper #! line (#!/bin/sh or #!/bin/bash), and invoke the script directly rather than passing its name to the sh command. Neither of these is necessary, but they'll make your intent move obvious.
If delete.sh is in the /root directory, not under your home directory, then you should have:
0 0 * * * /root/delete.sh
If it's under $HOME/root, then you should have:
0 0 * * * $HOME/root/delete.sh
Again, this depends on delete.sh being executable (chmod +x delete.sh) and having a proper #! line at the top.