Questions tagged [distributed-computing]
The distributed-computing tag has no summary.
43 questions
Score of 0
0 answers
119 views
No Endpoints Available Error When Trying to Setup Distributed Transactions (DTC) Between Domain and Non-Domain SQL Servers
We have a primary database SQL Server 2022 Enterprise cluster using Always-On Activation Groups running in our domain and a small SQL Express 2022 running on a standalone Windows Server 2022 non-...
Score of 3
1 answer
315 views
sge: How to set hard limits of node?
The guy who administrates our cluster died suddenly and recently, so now we have to operate it ourselves until a new guy comes in. We want to change the hard runtime limit of a node on our cluster. ...
Score of -3
2 answers
237 views
Heterogeneous Cluster Solution for R&D
I work in a research laboratory with multiple physical machines with different specifications. The machines have different CPUs (some Intel, some AMD), different RAM sizes, some have discrete GPUs, ...
Score of 0
1 answer
130 views
Good technology for a large-scale batch operation on many S3 files in AWS Batch with Spot instances
I have an enormous corpus of text data stored in millions of files on S3. It's very common that I want to perform some operation on every one of those files, which uses only that file and creates a ...
Score of 0
0 answers
41 views
What are my options for a distributed, row-oriented database?
(Sorry if this isn't the right forum. StackOverflow doesn't seem right, either. I thought there used to be a description on the home page saying what kind of questions were relevant but I can't find ...
Score of 2
1 answer
2237 views
Can kubernetes cluster nodes be geologically spread out?
Me and a couple of friends are thinking of setting up a kubernetes cluster where our homeservers will act as the nodes.
As our nodes will be spread out between our apartments I am worried this will ...
Score of -1
1 answer
260 views
Volunteer Distributed computing like Folding@home
I'm a user of Folding@home and like its ability to leverage idle machine to process tasks. I'd like to do something similar with my work where I can allow users to volunteer their machines and have a ...
Score of 1
0 answers
271 views
Is it practical to keep home directories on OpenAFS?
I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various ...
Score of 0
0 answers
23 views
Need to convert 1000 images in 5 seconds-- what are our options? [duplicate]
we're looking for a server architecture that will allow for converting 1000 large images in 5 seconds. As a test, we ran some benchmarks using a 16 core server, using GNU Parallel to run 1,000 image ...
Score of 0
1 answer
3419 views
How to manage failover in ZooKeeper across datacenters using observers
I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
Score of -3
1 answer
303 views
Solutions for monetizing excess CPU cycles [closed]
My company has a big (relatively) computer farm, say, 100 physical servers (dual CPU hexacore e5 xeons with 160 Gb RAM) leased from some hardware provider (say Leaseweb or OVM) on monthly basis, means,...
Score of 4
2 answers
2245 views
How do I distribute HTTP traffic to the closest server?
This is kind of a two part question. So I have a DigitalOcean Droplet in Toronto with a lamp stack on it (with a website of course). I want to be create a snapshot of that droplet and deploy a clone ...
Score of 0
1 answer
4338 views
Nginx as GeoIP Global LoadBalancer and actual distance from app server
my client is using Magento for it's ecommerce global solution. Main country are US / EU / CN. For now only 1 VM in Italy, serving all traffic.
I would like to create 3 VMs, one for each country, on ...
Score of 2
1 answer
129 views
distributed storage solutions [closed]
I've got some desktop PCs available in my company since the last user hardware renewal and I would like to re-use them for a demo plaform. They are powerfull enought to emulate a few servers. I ...
Score of 1
1 answer
150 views
Distributed image processing on AWS: how to know the address of master node?
Context: I am building a mobile application that will let users apply advanced filters to their pictures. Since the processing can't be done on the phone, it will be offloaded to EC2 instances.
I ...