High performance application with asynchronous persistence

by Milkmaid   Last Updated July 12, 2019 08:05 AM

Web Application with huge amount of data (SQL REL DB) (not big in terms of memory < 2GB)

requested:

  • Fast calculation of the figures from data (Already cached from database and refreshed with any change done by whom ever)
  • Creating scenario (sandbox) from current data or from existing scenario (duplicating data in DB - takes long time)
  • Persist scenarios, updates in scenarios
  • Data are same for all instances (Currently 2 servers)

I am looking for solution as follow:

2 separate data source > one in memory and one in database

  • users work with in memory data (calculation, changes, duplicate for scenario)
  • after change in memory the persist into database is done asynchronously
  • User can store scenario (into DB) and load on demand into memory

Pros:

  • Speed of operations
  • No limitation from user perspective

Cons:

  • If server crash or any error appear some data not going to be persisted
  • Synchronization of data in memory between servers

Do you know about any 3rd party software (Java EE) which solving this problem with asynchronous database persistence?

Do you see any problem with proposed solution in general?



Related Questions


Updated October 15, 2018 05:05 AM

Updated August 16, 2018 23:05 PM

Updated August 29, 2017 11:05 AM

Updated January 20, 2018 17:05 PM

Updated May 26, 2015 22:02 PM