Commits

Breadcrumbs

History for

onc34343d

User selector

All users

All time

Commit History

Commits on Jun 10, 2010

• Now tracking the amount of concurrent writers to assure the channel is closed only when there is no one else writing to it. This assures that all tasks can continue working, and put their results a…

  Show description for 7c36f36
  Byron

  committed
  7c36f36

  Copy full SHA for 7c36f36

• channel: Changed design to be more logical - a channel now has any amount of readers and writers, a ready is not connected to its writer anymore. This changes the refcounting of course, which is wh…

  Show description for 55e7579
  Byron

  committed
  55e7579

  Copy full SHA for 55e7579

• InputChannelTask now has interface for properly handling the reading from the same and different pools

  Byron

  committed
  cfb278d

  Copy full SHA for cfb278d

Commits on Jun 9, 2010

• messy first version of a properly working depth-first graph method, which allows the pool to work as expected. Many more tests need to be added, and there still is a problem with shutdown as someti…

  Show description for 3323464
  Byron

  committed
  3323464

  Copy full SHA for 3323464

• test: prepared task dependency test, which already helped to find bug in the reference counting mechanism, causing references to the pool to be kepts via cycles

  Byron

  committed
  257a8a9

  Copy full SHA for 257a8a9

• task: redesigned write channel access to allow the task creator to set own write channels, possibly some with callbacks installed etc.. Pool.add_task will respect the users choice now, but provide …

  Show description for 365fb14
  Byron

  committed
  365fb14

  Copy full SHA for 365fb14

• Channel: Callbacks reviewed - they are now part of Subclasses of the default channel implementation, one of which is used as base by the Pool Read channel, releasing it of the duty to call these it…

  Show description for ea81f14
  Byron

  committed
  ea81f14

  Copy full SHA for ea81f14

• task: removed scheduled task support, which at some point was introduced to improve performance, but which now hinders performance, besides being unnecessary ;)

  Byron

  committed
  07996a1

  Copy full SHA for 07996a1

• Channel: removed pseudoconstructor, which clearly improves the design and makes it easier to constomize

  Show description for 57a4e09
  Byron

  committed
  57a4e09

  Copy full SHA for 57a4e09

• HSCondition: Fixed terrible bug which it inherited from its default python Condition implementation, related to the notify method not being treadsafe. Although I was aware of it, I missed the first…

  Show description for 4e6bece
  Byron

  committed
  4e6bece

  Copy full SHA for 4e6bece

• thread: fixed initialization problem if an empty iterable was handed in

  Show description for f2c8d26
  Byron

  committed
  f2c8d26

  Copy full SHA for f2c8d26

• queue: fixed critical bug in the notify method, as it was not at all thread-safe, causing locks to be released multiple times. Now it runs very fast, and very stable apparently.

  Show description for 15941ca
  Byron

  committed
  15941ca

  Copy full SHA for 15941ca

Commits on Jun 8, 2010

• workerthread: adjusted to use a blocking queue, it will receive termination events only with its queue, with boosts performance into brigt green levels

  Byron

  committed
  772b956

  Copy full SHA for 772b956

• Revised task deletion works well, adjusted test to be creating new tasks all the time instead of reusing its own one, it was somewhat hard to manage its state over time and could cause bugs. It wor…

  Show description for e5c0002
  Byron

  committed
  e5c0002

  Copy full SHA for e5c0002

• task: now deletes itself once its done - for the test this doesn't change a thing as the task deletes itself too late - its time for a paradigm change, the task should be deleted with its RPoolChan…

  Show description for 13dd59b
  Byron

  committed
  13dd59b

  Copy full SHA for 13dd59b

• Its getting better already - intermediate commit before further chaning the task class

  Byron

  committed
  619c117

  Copy full SHA for 619c117

Commits on Jun 7, 2010

• Task scheduled items lock now uses a dummy lock in serial mode, improving its performance considerably.

  Show description for 898d47d
  Byron

  committed
  898d47d

  Copy full SHA for 898d47d

• introduced a new counter keeping track of the scheduled tasks - this prevent unnecessary tasks to be scheduled as we keep track of how many items will be produced for the task at hand. This introdu…

  Show description for def0f73
  Byron

  committed
  def0f73

  Copy full SHA for def0f73

• improved testing to test the actual async handling of the pool. there are still inconsistencies that need to be fixed, but it already improved, especially the 4-thread performance which now is as f…

  Show description for be06e87
  Byron

  committed
  be06e87

  Copy full SHA for be06e87

• task: Fixed incorrect handling of channel closure. Performance is alright for up to 2 threads, but 4 are killing the queue

  Byron

  committed
  654e54d

  Copy full SHA for 654e54d

• Moved pool utilities into util module, fixed critical issue that caused havok - lets call this a safe-state

  Byron

  committed
  583cd88

  Copy full SHA for 583cd88

• added high-speed locking facilities, allowing our Queue to be faster, at least in tests, and with multiple threads. There is still an sync bug in regard to closed channels to be fixed, as the Task.…

  Show description for edd9e23
  Byron

  committed
  edd9e23

  Copy full SHA for edd9e23

• Added task order cache, and a lock to prevent us walking the graph while changing tasks

  Show description for 8c3c271
  Byron

  committed
  8c3c271

  Copy full SHA for 8c3c271

• changed scheduling and chunksize calculation in respect to the task.min_count, to fix theoretical option for a deadlock in serial mode, and unnecessary blocking in async mode

  Byron

  committed
  619662a

  Copy full SHA for 619662a

• pool.consumed_tasks: is now a queue to be thread safe, in preparation for multiple connected pools

  Show description for a8a448b
  Byron

  committed
  a8a448b

  Copy full SHA for a8a448b

Commits on Jun 6, 2010

• pool: First version which works as expected in async mode. Its just using a single task for now, but next up are dependent tasks

  Byron

  committed
  6a25266

  Copy full SHA for 6a25266

• Plenty of fixes in the chunking routine, made possible by a serialized chunking test. Next up, actual async processing

  Byron

  committed
  1b27292

  Copy full SHA for 1b27292

• First step of testing the pool - tasks have been separated into a new module including own tests, their design improved to prepare them for some specifics that would be needed for multiprocessing s…

  Show description for b3cde0e
  Byron

  committed
  b3cde0e

  Copy full SHA for b3cde0e

• thread: adjusted worker thread not to provide an output queue anymore - this is handled by the task system

  Show description for ec28ad5
  Byron

  committed
  ec28ad5

  Copy full SHA for ec28ad5

Commits on Jun 5, 2010

• Improved pool design and started rough implementation, top down to learn while going. Tests will be written soon for verification, its still quite theoretical

  Byron

  committed
  b72e270

  Copy full SHA for b72e270

• Renamed mp to async, as this is a much better name for what is actually going on. The default implementation uses threads, which ends up being nothing more than async, as they are all locked down b…

  Show description for ab59f78
  Byron

  committed
  ab59f78

  Copy full SHA for ab59f78

Loading