Maximize Server Usage for run multiple cron which have same command
I have 8 GB VPS (average 20% usage). Let's say it only has 1 cron.
- Cron run every minute
- 1 cron execute 10 data
- 1 cron finish to execute in 1.5 minutes
- Because time overlapping, i implemented CRON LOCKING (if not my server will always reach 100% CPU USAGE)
The problem begin here:
Every day i have some new members, which will make data more bigger/crowded. Every minutes i have 20 new data.
This means i late to execute 10 data in each minute.
After 2 months, i realize that data which must be executed now, must be waiting 200 minutes more. Thats horrible.
What i think to solve this is:
1. add another line in the crontab
before:
* * * * * mycommand
to:
* * * * * mycommand
* * * * * mycommand
* * * * * mycommand
- create several linux user and give them same cron command
.
before:
user1: * * * * * mycommand
to:
user1: * * * * * mycommand
user2: * * * * * mycommand
user3: * * * * * mycommand
because i worried about this, so i want to hear several opinion here first. I just want to use 40-60% my CPU resource.
And the last, i just wonder how big company with a lot of user/transaction, run their cronjob. I am really out of idea about that.
Thanks for sharing with me, i really appreciate any help.
linux cron
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I have 8 GB VPS (average 20% usage). Let's say it only has 1 cron.
- Cron run every minute
- 1 cron execute 10 data
- 1 cron finish to execute in 1.5 minutes
- Because time overlapping, i implemented CRON LOCKING (if not my server will always reach 100% CPU USAGE)
The problem begin here:
Every day i have some new members, which will make data more bigger/crowded. Every minutes i have 20 new data.
This means i late to execute 10 data in each minute.
After 2 months, i realize that data which must be executed now, must be waiting 200 minutes more. Thats horrible.
What i think to solve this is:
1. add another line in the crontab
before:
* * * * * mycommand
to:
* * * * * mycommand
* * * * * mycommand
* * * * * mycommand
- create several linux user and give them same cron command
.
before:
user1: * * * * * mycommand
to:
user1: * * * * * mycommand
user2: * * * * * mycommand
user3: * * * * * mycommand
because i worried about this, so i want to hear several opinion here first. I just want to use 40-60% my CPU resource.
And the last, i just wonder how big company with a lot of user/transaction, run their cronjob. I am really out of idea about that.
Thanks for sharing with me, i really appreciate any help.
linux cron
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I have 8 GB VPS (average 20% usage). Let's say it only has 1 cron.
- Cron run every minute
- 1 cron execute 10 data
- 1 cron finish to execute in 1.5 minutes
- Because time overlapping, i implemented CRON LOCKING (if not my server will always reach 100% CPU USAGE)
The problem begin here:
Every day i have some new members, which will make data more bigger/crowded. Every minutes i have 20 new data.
This means i late to execute 10 data in each minute.
After 2 months, i realize that data which must be executed now, must be waiting 200 minutes more. Thats horrible.
What i think to solve this is:
1. add another line in the crontab
before:
* * * * * mycommand
to:
* * * * * mycommand
* * * * * mycommand
* * * * * mycommand
- create several linux user and give them same cron command
.
before:
user1: * * * * * mycommand
to:
user1: * * * * * mycommand
user2: * * * * * mycommand
user3: * * * * * mycommand
because i worried about this, so i want to hear several opinion here first. I just want to use 40-60% my CPU resource.
And the last, i just wonder how big company with a lot of user/transaction, run their cronjob. I am really out of idea about that.
Thanks for sharing with me, i really appreciate any help.
linux cron
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I have 8 GB VPS (average 20% usage). Let's say it only has 1 cron.
- Cron run every minute
- 1 cron execute 10 data
- 1 cron finish to execute in 1.5 minutes
- Because time overlapping, i implemented CRON LOCKING (if not my server will always reach 100% CPU USAGE)
The problem begin here:
Every day i have some new members, which will make data more bigger/crowded. Every minutes i have 20 new data.
This means i late to execute 10 data in each minute.
After 2 months, i realize that data which must be executed now, must be waiting 200 minutes more. Thats horrible.
What i think to solve this is:
1. add another line in the crontab
before:
* * * * * mycommand
to:
* * * * * mycommand
* * * * * mycommand
* * * * * mycommand
- create several linux user and give them same cron command
.
before:
user1: * * * * * mycommand
to:
user1: * * * * * mycommand
user2: * * * * * mycommand
user3: * * * * * mycommand
because i worried about this, so i want to hear several opinion here first. I just want to use 40-60% my CPU resource.
And the last, i just wonder how big company with a lot of user/transaction, run their cronjob. I am really out of idea about that.
Thanks for sharing with me, i really appreciate any help.
linux cron
linux cron
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
asked 10 mins ago
plonknimbuzzplonknimbuzz
1011
1011
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
plonknimbuzz is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
plonknimbuzz is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f506772%2fmaximize-server-usage-for-run-multiple-cron-which-have-same-command%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
plonknimbuzz is a new contributor. Be nice, and check out our Code of Conduct.
plonknimbuzz is a new contributor. Be nice, and check out our Code of Conduct.
plonknimbuzz is a new contributor. Be nice, and check out our Code of Conduct.
plonknimbuzz is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f506772%2fmaximize-server-usage-for-run-multiple-cron-which-have-same-command%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
