403 reputation
315
bio website
location San Francisco, CA
age
visits member for 3 years, 8 months
seen Dec 2 at 8:35

Mar
7
comment Data architecture for event log metrics?
UPDATE over a year later we built a system that logged everything, and periodically iterated over the logs counting things, and then stored those counted numbers into a database (could/should have been a a time-series database, but MySQL sufficed). This was a few weeks of work but ended up being a surprisingly powerful/fast approach--when it's just your code iterating over logged JSON, it's easy to add a lot of metadata, and easy for your code to have flexible rules for exactly what it wants to count.
Jan
8
comment Can Clojure's thread-based agents handle c10k performance?
Thanks! If you are curious, it appears that modern NPTL threads are quite capable, e.g. see http://stackoverflow.com/a/4058620/37610
Jan
8
comment Data architecture for event log metrics?
@hiwaylon We've ended up using a hybrid system: 1) MySQL where possible (low volume) (makes aggregation easy using SELECT...GROUP BY, can easily store the results of SELECTs), 2) using Graphite for simple large-scale aggregation and visualization, and 3) logging full events for reference, and for watching details of the data flow in in real time. Each has actually been valuable in different ways.
Sep
17
comment Data architecture for event log metrics?
"aggregate the data, but store the details in a (compressed) file". Great thought in particular, thanks!
Mar
30
comment Duck checker in Python: does one exist?
@deinan Right, but once you're seeing a failure, and your users are seeing a failure page, how do you know what caused the failure and when? The local failure / mismatched assumption may not be the root cause failure to match assumption.
Mar
30
comment Duck checker in Python: does one exist?
@psr Checks should occur 1) Either when an object is created, or when you first add the validator to the object, 2) Any time the object is mutated, e.g. foo.bar = baz Yes, it's all doable manually, but there's no reason why should have to write the same boiler plate over every attribute of every object.
Mar
30
comment Duck checker in Python: does one exist?
@Izkata. Right, exactly! It seems like there should be a library that can automatically declare and enforce those across a wide number of aspects of an object at once, and I am curious if that library exists.
Mar
27
comment Visually and audibly unambiguous subset of the Latin alphabet?
Neat, useful, thank you!
Mar
26
comment Visually and audibly unambiguous subset of the Latin alphabet?
@MSalters The "Latin script" is a linguistics idea, for our purposes I really just mean "select from the subset of the Latin script that is codified into Unicode," e.g. en.wikipedia.org/wiki/ISO/IEC_8859-1
Mar
25
comment Visually and audibly unambiguous subset of the Latin alphabet?
Fascinating, thank you!
Sep
26
comment How do I get into a career in distributed systems?
Thank you, I appreciate the thoughtful answer! Will definitely check out the publications and projects you mentioned.
May
3
comment How do I get into a career in distributed systems?
Good point, thanks. I guess more specifically I am wondering if anyone know what the entry-level tasks in the distributed systems world are, so I can go get some experience in those.