Skip to content

BlackToppStudios/DAGFrameScheduler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

README

The DAGFrameScheduler is a Multi-Threaded lock free and wait free scheduling library designed for use in video games.

The source code is stored publically at https://github.com/BlackToppStudios/DAGFrameScheduler

This is licensed under the GPL v3 license as per the file 'LICENSE'.

See COMPILING.md for details on building this library.

Project layout

The 'src' folder includes the source and header in the library.

The contents of the 'tests' folder are required only for verifying the library works.

The 'doc' folder contains further licensing details, technical documentation and notes BTS developers may a have left.

Doxygen Docs

Doxygen is used to generate the technical docs in the 'doc/html' folder. This generates a series of html files from the source code. See 'index.html' for an overview of the API and a good starting point for perusing the documentation.

The Doxygen configuration resides in 'doc/doxyfiles'. From this directory the you can create contents of the 'doc/html' directory with a command similar to doc/doxyfiles$ doxygen Doxyfile 2> DoxygenWarnings.txt depending on your platform. To get the higher quality graphs 'graphviz' and 'dot' need to be installed and doxygen needs to be able to find them. You can also enable the CMake option 'Mezz_Doc' to build the doxygen documentation when you build the code as well.

NEWS

Mar 22, 2014 - 1.14.2

  • Added some convenience methods that make it easier to get time statistics about the last frame
  • Removed a unit test that only tested assumptions the Framescheduler relied on and sometimes crashed other unittests

Mar 9, 2014 - 1.14.1

  • Identified a race condition in Mutexes on Mac OS 10.6.8 that locks tests in about 50% of trials
  • Split Unit tests for mutexes into smaller groups to ease future troubleshooting.
  • Ran Mutex, Spinlock and ReadWriteSpinLock tests 20 times each to ensure confidence in Linux implementation.
  • Removed a compiler warning in FrameScheduler::WaitUntilNextFrame() about a potentially unitialized variable.

Feb 26, 2014 - 1.14.0

  • I left some test code in place in the Barrier. This cause undefined references on some compilers and has been removed.

Feb 26, 2014 - 1.13.0

  • Fixed barrier and added a better tests for it.
  • Change Boolean to Boole to dodge name collision on Mac OS X and to Match Mezzanine.

Feb 22, 2014 - 1.12.0

  • Merged many changes from Mezzanine

Test updates

  • Unit tests framework now captures Standard output of test, unless c std output is used.
  • Updated copyright dates to 2014
  • Fixed return code of unit tests (Useful for CI systems)
  • Added macros for testing with a floating point delta TEST_EQUAL_EPSILON and TEST_EQUAL_MULTI_EPSILON
  • Fixed bug with Faulty TEST_THROW macro that caused some test to pass incorrectly

Actual updates to stuff you want to use

  • I think I fixed WINAPI build issue in thread.h
  • Reduced size of workunit to size of cache line on all architectures (I think)
  • Prepared All of the Framescheduler for creating SWIG bindings
  • Added LockGaurd, ReadWriteSpinlock
  • Moved SpinLock to its own file
  • Fixed a test in the Barrier that was incorrectly passing because of synchronization in the std streams
  • Added Maintanence section to documentation

October 11, 2013 - 1.11.1

  • Merge changes from Mezzanine for cleaning up included headers.

October 11, 2013 - 1.11.0

  • Sqeaky's Birthday Update!
  • Include a few minor bugfixes
  • Simplified Threading::Thread::Id into its own Class Threading::ThreadId
  • Included preprocessor support for using SWIG to generate Lua Bindings

September 3, 2013 - 1.10.2

  • Merged Mako's fixes for the mutex
  • Attempt to fix build on Windows with inluding system headers in Mezzanine headers.
  • Tweaked doxygen doc settings to more closely match Mezzanine

September 1, 2013 - 1.10.1

  • Fixed Tests relying on Now() in windows.
  • Documentation fixes in headers.
  • Fixed some undefine d references on windows by including MEZZ_LIB. Some of the changes this go around were to the testing and merge in frame the Mezzanine to keep the codebase similar
  • Added option to test framework for asked questions with warngins as results.
  • Test tracking or ArgC and ArgV to make referencing them easier in tests.
  • Added Bool to keep integration with Mezzanine clean.

August 18, 2013 - 1.10.0

  • Added LogTools which provides an automatic scoped timer that logs its results as xml.
  • Log Dependency data when dependency data has changed.
  • Added tests for log tool ScopedTimer

August 17, 2013 - 1.9.1 - 1.9.2

  • Merge warning fixes in from the Mezzanine
  • Emit Frame length and Pause length to log each frame.

August 16, 2013 - 1.9.0

  • Bumped version to where I meant to yesterday.
  • merged pause and frame time returns are swapped bugfix from Mezzanine.

August 15, 2013 - 1.8.0

  • Added work unit names without increasing the size of the work units. When any function on the FrameScheduler is called that adds a work unit, A name must be provided. This name is logged along with a unique ID (Currently a pointer interpretted as an integer). This is logged along with other log messages allowing tools to assemble the information from any log.

August 12, 2013 - 1.8.1

  • Fixed bug with innacurate metadata tracking, now frame and pause lengths are correct.

August 11, 2013

  • Added tracking for pause and frame length each frame (no tests yet, I don't think it works right).
  • Split TEST macros and helpers into their own file.
  • Added querying features to rolling averages.
  • Bumped version to 1.8.0.

August 5, 2013

  • Removed forward declaration for LogBufferSwapper, Functionality is now integrated into thread creation.
  • Removed a few warnings from FrameSchedulerTests
  • Bumped version to 1.7.1 (If your code depended on useless forward declares it wasn't really compatible, Just a linker error waiting to happen).

August 4, 2013

  • A bunch of log format changes, some merged from the Mezzanine. Log is now compliant XML and has more metadata and should be faster.
  • Added a SpinLock threading primitive so now there are more performance choices when choosing exclusion/synchronization primitives.
  • Fixed a Race condition that sometimes caused LogAggregator to swap buffer on DoubleBufferResource before/as it was created by FrameScheduler::CreateThreads.
  • All Unit test
  • Bumped version to 1.7.0, skip 1.6.x entirely if you use logging.

August 2, 2013

  • Fixed an issue where log buffers (and potentially all double buffered resources) where not being swapped if they were associated with the main thread.
  • Fixed many but not all of the Tests that involv reading logs
  • Bumping version to 1.6.1, consider 1.6.0 too buggy to use if you need reliable logs.

August 1, 2013

  • Removed Buffer swapper and integrated buffer swapping for double buffered resources into thread creation, it likely performs better and is certainly simple
  • Added checking support for openMP to the CMake configuration
  • Default LogStream is now a file name "Mezzanine.log" and the previous contents are truncated.
  • Upgraded testing tools: Added debugtests as an option, and added no throw tests
  • Now version 1.6.0 (missed 1.5 in the Mezzanine core)
  • If some unit tests fail and they are only the ones related to logging in the framescheduler there is no problem.

July 28, 2013

  • Added Functions for getting the ThreadSpecificResource from the FrameScheduler without needing to have it passed into a workunit, but there is a cpu time cost, and likely a cache miss.
  • Added another function that retrieves the usable logger in a similar way.
  • Added tests for these functions.
  • Changed Default log target to "Mezzanine.log"
  • bumped version to 1.5.0

July 21, 2013

  • Fixed Mac OS X versions of performance/size test functions
  • Document fixes
  • Refactored two tests I missed before AsyncWorkUnit and Barrier
  • now version 1.4.3 and then 1.4.4

July 18, 2013

  • Fixed warnings in vc++, gcc on Mac OS and MinGW, but a bug in MinGW prevents querying cache properly on windows and Mac OS cache querying is unimplemented
  • bumped revision to 1.4.2

July 18, 2013

  • Completely refactored and increased the reliability of the unit tests.
  • Add a function for getting cache size and added test that warns if certain structures are larger than that.
  • Bumped revision number to 1.4.1

July 13, 2013

  • Upgraded the TestData to contain more metadata than before.

July 12, 2013

  • Added Automatic build support and IDE for doxygen
  • Corrected all doxygen warnings

July 10, 2013

  • Removing work units now works correctly and there are tests to prove it.
  • Add some methods to inspect the counts of work units in a framescheduler.
  • Since the API changed I bumped the minor version again, now the version is 1.4.0.

July 6, 2013

  • Fixed an issue that could in rare situations segfault or spawn an infinite loop because of mismatched iterators.
  • Replaced testing framework with a similar design to the Mezzanine Tests to make integration more seamless.
  • Adjusted the includes for compiler detection worked to match the Mezzanine to make integration more seamless.

Jan 14, 2013

  • Mako made some const correctness changes.
  • Fixed some documentation typos.

Jan 13, 2013

  • Documentation Updates, finished basic integration docs.
  • Update copyright dates.

Dec 27, 2012

  • Documentation Updates

Dec 20, 2012

  • A better fix for a visual studio compiler bug involving the max macro.

Dec 19, 2012

  • Added option for configuring how long frames track performance. A few other options throughout the library also use this.
  • Complete the Work Unit Sorter and tested. There is no proper unit test for this, but the helperunits does emit a verbose log in debug mode to facilitate debugging features like this.
  • I added a potential optimization that should skip many cache flush when working with large amount of workunits, this can be enabled with the Mezz_DecacheWorkUnits CMake option.

Dec 16, 2012

  • I added proper markdown to the README and added a document, COMPILING.md that loosely describes the build process and some of the technicial decisions made while creating this library.
  • Further cleaning of doxygen docs. Almost done with main algorithm page.
  • Started work on a WorkSorter work unit to offload execution time of that into another thread, to maximize concurrency.
  • Simplifed FrameScheduler::DoOneFrame() and made frame pause timings more accurate, down to around .004% variance on my dev system.

Dec 14, 2012

  • A large documentation update. No more warnings in doxygen doc generation. I still need to describe the algorithm in greater detail on the main page though.

Dec 13, 2012

  • I reimplemented parts of the algorithm allowing for the creation of an option that enables or disables thread creation each frame. This uses two Barriers to performs synchronizations twice during the a frame. In theory on systems with atomic operations this should be faster, and on system without it should be slower, but my testing has not been so conlusive.
  • Grouped CMake Options.
  • Updated doxygen docs. I also added some random scriblings and notes I have written to the docs folder.

Dec 9, 2012

  • Added an example Asynchronous File loading workunit that seems to perform near the peak capacity of the hardware I tested it on. Also a little bit of documentation cleanup.
  • I fixed an issue with removing workunits from the framescheduler, but this functionality currently has no test.
  • Again, I compile one multiple compilers (gcc, mingw, vs2010) ensuring that all tests pass and no warnings are produced.

Dec 7, 2012

  • Removed friendships between WorkUnit and FrameScheduler (Some core algorithm classes keep this though).
  • Separated the WorkUnits Implementation from its interface. I did not do this with the other work units, it seems that this will satisfy most customization needs along with changing the inheritance of the other workunits.

Dec 6, 2012

  • Removed all occurrences of volatile keyword.
  • Added a Barrier synchronization class.

Dec 4, 2012

  • Fixed a scheduling issue which caused a thread to stall on a specific workunit if it had unment dependencies.
  • Test for thread affinity emits manually checkable contents and passes manual inspection.
  • I found a bug with the the 'threadrestart' test, where it sometimes runs all wokunits on one thread. This is not ideal, but it is valid, I have found a way to fix this, but it will take time to implement.

Dec 3, 2012

  • Simplified parameter passing to WorkUnits now they only recieve one ThreadSpecific storage.
  • Re-worked pause timing algorithm to make it more simple. Logically it just carries a portion of any amount it was off into the next frame.
  • Updated documentation. I have started a small project attempt to read/revise every piece of doxygen docs going over each file alphabetically to and I am at framescheduler.h.

Dec 2, 2012

  • Fixed warnings in Mingw, clang and VS2012. 0 warnings in any of these compilers at this moment and it passes tests in windows/linux with these compilers where applicable.
  • Removed integer overflow in some places where the results of GetTimeStamp() were assigned to datatypes smaller than 64 bit.

Dec 1, 2012

  • Enabled all build warnings, and corrected them in GCC.
  • Updated the way unit tests are run to allow the isolated of execution of one test or all the tests at once. Fixed Framerate calculation bugs in performane tests.

Nov 30, 2012

  • Created a single point at which to update all the creation of double buffered resources. The goal is to make changing this easy if another project wants to add double buffered resources to each thread.
  • Added WorkUnit affinity. A special way to add WorkUnits so that they will be scheduled with the rest of the WorkUnits, but only executed on the main thread.
  • More Documentation updates.

Nov 29, 2012

  • Documentation updates.

Nov 28, 2012

  • Bugfixes with workunit sorting and a simple performance test has been added.

Nov 27, 2012

  • Removed Bi-Directionality from Dependency Graph. At their largest WorkUnits are now 56 bytes. This was done so that they would fit in a single cache line on most systems. This also speeds up adding or removing WorkUnits. When the information the Reverse dependency graph needed is required a temporary cache is updated on the scheduler itself. When this depedent (no cy) graph is updated the WorkUnitKeys used for sorting the work are also updated. This can done with calls to FrameScheduler::UpdateDependencyCache and can be control with a bool argument passed in to FrameScheduler::SortWorkUnits().

Nov 26, 2012

  • Verified support for Mac OS X. Now this compiles on Mac os X 10.6.8 with GCC 4.2.1, Ubuntu x64 with GCC 4.3.2 or Clang 3.0.6-6, or on windows xp with MinGW or visual studio 10.
  • Timing test on Mac OS X and Linux both have submicrosecond accuracy, and they both provide 1 microsecond times, winxp does not, but this is still accurate on the order of 1000s of microseconds, and the timer is usually about that accurate.

About

The DAGFrameScheduler is a Multi-Threaded lock free and wait free scheduling library designed for use in video games.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published