The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
0answers
27 views

Bi-directionally synchronize/mirror folders over the internet

I am programming on the C# stack, but I have next to none Azure experience. We have several customers who have various processing needs on data files that reside at the customers computers. We want ...
3
votes
1answer
178 views

What is the most sensible design for making files available for download from a URL?

This is what I need to do, in a nutshell: Generate Excel spreadsheet files (programmatically). Store these .xlsx files in a location where they can be accessed by users later. These files need to ...
0
votes
0answers
30 views

Storing mass user-files

I am thinking about the concepts of a web-application in which users can upload files to the server. I have multiple questions about the storage of these files. Imagine a service with 10,000+ users ...
2
votes
3answers
213 views

Design pattern for large amounts of overflowing data?

Our current queues publish messages that consumed by 3rd party services with rate limits. Currently the messages are retried with exponential back-off. However there could be cases where data is ...
1
vote
1answer
46 views

How to deal with dual servers and temporary files

Our application is hosted on a dual-server environment - when one server is overloaded with work, a secondary server will take its place in processing certain actions. For most purposes, this isn't a ...
0
votes
1answer
65 views

What is a simple way to let a user select a folder from a tree?

I have a Python-Flask app in which users can place files into a folder. As of now the directory structure is something like: /app /storage /templates . . . server.py The ...
1
vote
2answers
200 views

Why do filesystems read and write in blocks?

I read that file systems usually access data in blocks, whose size is integral multiple of disk block size. Why don't they read individual disk blocks?
1
vote
3answers
344 views

Why do we need a format for binary executable files

When binary files (i.e. executables) are saved they usually have a format (e.g. ELF or .out) where we have a header containing pointers to where data or code is stored inside the file. But why don't ...
3
votes
3answers
2k views

storing and retrieving millions of documents using c#

I am working on an integration project, where my “app/web service” will sit in the middle serving documents. Basically, a request is sent with the document id as part of the query string, I check if ...
2
votes
1answer
422 views

Binary data storage scheme (saving user-uploaded files)

In our app we are currently saving binary data to the database (terrible, I know; but this is legacy stuff and it wasn't my decision). We're trying to migrate this data out to an external device and I'...
4
votes
3answers
848 views

Storing object-graphs with class-evolution in Java with transformation (long time archiving)

Abstract A common problem is to store objects (with graph), and to load them back. This is easy as long the stored object representation matches the executing code. But as time goes by, requirements ...
1
vote
2answers
2k views

All images in one folder for a website?

When creating websites, is it better to have a lot of images in one folder, or have them separated? It's something that has always been in my mind but I never researched enough about it, and googling ...
0
votes
2answers
137 views

Interaction between programs

I am writing an interactive program in which it takes speech input from the user for a specific list of commands. The list of commands will be stored locally in a graph and based on the usage their ...
1
vote
3answers
748 views

File storage for a blog component: database or filesystem?

I'm going to develop a fairly basic re-usable blog component, with simple CRUD operations using ASP.Net. Which method of storing blog posts would be best suited to the situation in terms of ...
0
votes
1answer
299 views

Are Python sockets suitable for file synchronization?

I'm working in an organisation with limited funds. They can't afford a business account on Dropbox. However, they would find it useful to have all their files synchronized on local machines. I've ...
2
votes
4answers
1k views

Best practice to sync long paths to filesystems where path length is limited?

I wrote a sync tool to synchronize folders/files from Alfresco to Windows. PROBLEM: In Alfresco, /files/can/have/very/very/very/long/filepaths/like/this.txt The Windows API prevents me from creating ...
2
votes
1answer
5k views

How are Java ByteBuffer's limit and position variable's updated?

There are two scenarios: writing and reading Writing: Whenever I write something to the ByteBuffer by calling its put(byte[]) method the position variable is incremented as: current position + size of ...
5
votes
1answer
229 views

Why use binary files to stack up different versions on DMSs?

I've used both Liferay and Alfresco trying to use them as the Document Management System for an intranet. I noticed the following: They use the file system and the database to store files They use ...
2
votes
2answers
129 views

What is the best strategy for transforming unicode strings into filenames?

I have a bunch (thousands) of resources in an RDF/XML file. I am writing a certain subset of the resources to files -- one file for each, and I'm using the resource's title property as the file name. ...
40
votes
2answers
3k views

What is the benefit of writing to a temp location, And then copying it to the intended destination?

I am writing an application that works with satellite images, and my boss asked me to look at some of the commercial applications, and see how they behave. I found a strange behavior and then as I was ...
2
votes
1answer
259 views

Flexible cloud file storage for a web.py app?

I'm creating a web app using web.py (although I may later rewrite it for Tornado) which involves a lot of file manipulation. One example, the app will have a git-style 'commit' operation, in which ...
4
votes
3answers
515 views

For performance critical situations is storing file metadata in a database better?

As per the title of this question, for extremely performance critical situations, is storing a file's metadata (e.g. location, size, download on, etc) in a database going to allow for better ...
2
votes
3answers
196 views

Do you do any validation on directories when recursively deleting them?

How do you recursively delete paths of the data that your app created? The deleting process itself is trivial. The question is, do you do extra validation? And if so, what kind? From one point of ...
4
votes
2answers
789 views

How do other people keep code current accross multiple machines? (something other than DropBox) [duplicate]

I am a hardware/infrastructure guy going back to school to get my degree (FINALLY...) and am taking some low level intro programming classes. On top of the JAVA I am working on at school, I am also ...
2
votes
2answers
510 views

What is the best way to store files when using winforms and web?

I have to develop an application (in C#) that has to work with files. The application consists of two versions: a web version and a windows version. Therefore, the files must be stored on a place ...
1
vote
2answers
307 views

Storing documents in DMS

I need your opinions and suggestions about storing documents in a DMS system. I think the DMS should save its own copies of the documents, not their original path on the disk. So, the DMS should have ...
2
votes
3answers
140 views

best practice: setting up several IDE / frameworks (at file/dir level) [closed]

I don't know how to exactly search for this topic, so if there are a lot of answers to that, please just provide a link :) I'm getting a new laptop in a few weeks and am thinking about setting up a ...
38
votes
6answers
28k views

“Standard” format for using a timestamp as part of a filename [closed]

I searched for a standard format for using a date/time as part of a file name and was unable to come up with anything. My question is two parts: Is using time stamps to enforce unique in file names ...
11
votes
4answers
3k views

Is there a better alternative to the folder-based file system, and will it be replaced any time soon? [closed]

All file systems I've encountered have been based on folders - you have a root folder, which contains files and subfolders, which in turn contains files and subfolders, and so on. Is there a better ...