Questions tagged [batch-processing]
The batch-processing tag has no summary.
53 questions
Score of 2
1 answer
210 views
How do I get latency and throughput metrics for an Azure OpenAI Batch API endpoint?
I run jobs through the Azure OpenAI Batch API (Global Batch deployment) and I want
the same monitoring view I get for synchronous deployments, specifically:
Time to first byte (TTFB) / Time to last ...
Score of 3
1 answer
375 views
How can I set the capacity or Tokens Per Minute (TPM) rate limit to the minimum for all model deployments across an entire Azure subscription?
The capacity or Tokens Per Minute (TPM) rate limit of the model deployments across in my Azure subscription are a mess:
[table is chopped]
How can I set the capacity or Tokens Per Minute (TPM) rate ...
Score of 0
1 answer
130 views
Good technology for a large-scale batch operation on many S3 files in AWS Batch with Spot instances
I have an enormous corpus of text data stored in millions of files on S3. It's very common that I want to perform some operation on every one of those files, which uses only that file and creates a ...
Score of 0
0 answers
275 views
How to write a batch job query that has wait times, dependencies and conditional execution?
I'm trying to write a batch job that executes via task scheduler. The objective is to run these exe jobs sequentially. However, some of these jobs have dependencies on others. for eg.
job1.exe (no ...
Score of 0
1 answer
3868 views
Get the previous day date as variable in batch file from powershell command output
The scenario is like this. I need a previous day date (i.e. Today -1) as variable in a batch file. But if previous day is Sunday (i.e. script running on Monday) it should return the Saturday's date (i....
Score of 1
1 answer
837 views
Having issues with mkdir, robocopy, to date\time folders in a looping batch file
I have searched everywhere but cannot find a solution.
Im unsure what is going on here but I desperately need some help in regards to this issue,
Im running a batch file (Script for a game Server ...
Score of 0
1 answer
544 views
Several short consecutive SSH connections
Imagine performing a short repetitive process, which ends by doing a short lived SSH connection to some server (e.g. transferring a newly generated file via SFTP). This means that there will be a lot ...
Score of 1
1 answer
3982 views
Windows batch file scripting: how to get directory named with latest date (yyyy-mm-dd format)?
I have a directory with many subdirectories. Each subdirectory is named with the yyyy-mm-dd format. I'm writing a Windows batch file and I need to grab the directory name with the most recent date and ...
Score of 0
1 answer
4389 views
Server load handling : One single batch request vs multiple requests
I was talking to a developer about different apis for create, update and delete and he was saying that it was better to have a single batch request to server to do operations like create, update and ...
Score of 1
1 answer
1999 views
How do I prevent additional jobs from a given user from starting?
With the Slurm workload manager how can I prevent more jobs from user bob from starting? Existing jobs should continue to run. The user should be able to submit more jobs but they shouldn't be able to ...
Score of -1
2 answers
378 views
How to create a batch file which after some time execute a file but if interrupted execute another?
I want to automate my ms office installation 2007 or 2010 running a batch file.
I am thinking having an options menu 1.Office 2007 2.Office2010
When started I want my timer to start..lets say 20secs
...
Score of 1
2 answers
10520 views
Running supervisord process as root
My goal is to run sudo inside one of the programs:
[program:doStaff]
command=sudo python manage.py doStaff
autostart=true
autorestart=true
stderr_logfile=/var/log/doStaff.err.log
stdout_logfile=/var/...
Score of 1
2 answers
417 views
Containers for HPC batch processing
We are facing the problem that a lot of people want to run different scientific software on our high performance computing cluster.
Every user requires a different set of libraries and library ...
Score of 1
3 answers
7612 views
windows start nginx and php-fpm in background in the same bat
I'm trying to create a bat file on windows 10 to start the nginx and php-fpm in background.
At the moment I can do that but the command window (black window) remains open. If I close the window the ...
Score of -1
1 answer
64 views
Scheduled tasks
Overview:- I need to download a csv file every 10 mins from an intranet site. This is done using a batch file.
To ensure that it happens with out any delay, i have set up multiple tasks using Windows ...