/[neo]/branches
ERP5 logo

Log of /branches

View Directory Listing Directory Listing

Sticky Revision:
Revision 1285 - Directory Listing
Modified Fri Sep 18 12:27:40 2009 UTC (3 years, 8 months ago) by gregory 
Remove duplicate computation of next TID, from protocol tests and master
application.
Revision 1284 - Directory Listing
Modified Thu Sep 17 13:43:59 2009 UTC (3 years, 8 months ago) by gregory 
Fix connection tests (use getNewUUID from the test instance instead of global)
Revision 1283 - Directory Listing
Modified Thu Sep 17 13:33:39 2009 UTC (3 years, 8 months ago) by gregory 
Tests for generic bootstrap module no more give a configuration file.
Revision 1282 - Directory Listing
Modified Thu Sep 17 13:31:11 2009 UTC (3 years, 8 months ago) by gregory 
Fix base handler test: 
* It now requires an app parameter
* KeyError and ValueError are no more catched  when looking for the handle
method.
Revision 1281 - Directory Listing
Modified Thu Sep 17 13:29:49 2009 UTC (3 years, 8 months ago) by gregory 
Fix node tests: 
* Mock object doesn't not implement equality test, so use identity check
* Nodes state is now defaulted to UNKNOWN_STATE.
Revision 1280 - Directory Listing
Modified Thu Sep 17 12:56:49 2009 UTC (3 years, 8 months ago) by gregory 
Fix tests to no more use a configuration file. 
Remove related test module and its entry in the test runner.
Revision 1279 - Directory Listing
Modified Thu Sep 17 12:55:39 2009 UTC (3 years, 8 months ago) by gregory 
Fix generic dispatcher module import.
Revision 1278 - Directory Listing
Modified Thu Sep 17 12:52:16 2009 UTC (3 years, 8 months ago) by gregory 
Remove config module dans sample configuration file, their are no more usefull.
Revision 1277 - Directory Listing
Modified Thu Sep 17 12:47:39 2009 UTC (3 years, 8 months ago) by gregory 
Add percent status in unit tests report.
Revision 1276 - Directory Listing
Modified Thu Sep 17 12:42:24 2009 UTC (3 years, 8 months ago) by gregory 
No more use a configuration file, all neo applications use command line
arguments. This allow easily start new nodes over a network.
Revision 1275 - Directory Listing
Modified Thu Sep 17 12:02:25 2009 UTC (3 years, 8 months ago) by gregory 
Use a non-zero exit code for neoctl when a command fails. This allow check the
command success from a shell script.
Revision 1274 - Directory Listing
Modified Thu Aug 20 15:28:05 2009 UTC (3 years, 9 months ago) by gregory 
Support of George Bailey object (one who's creation has been transactionally
undone)
Revision 1273 - Directory Listing
Modified Thu Aug 20 15:24:43 2009 UTC (3 years, 9 months ago) by gregory 
Fix some unit tests.
Revision 1272 - Directory Listing
Modified Wed Aug 19 15:39:38 2009 UTC (3 years, 9 months ago) by gregory 
Factorize two conditions.
Revision 1271 - Directory Listing
Modified Thu Aug 13 07:46:54 2009 UTC (3 years, 9 months ago) by gregory 
All functional test cases call super metod setUp().
Revision 1270 - Directory Listing
Modified Thu Aug 13 07:45:21 2009 UTC (3 years, 9 months ago) by gregory 
Increase the maximum packet size to 64MB because the previous limit was easily
reached during import of existing data.
Revision 1269 - Directory Listing
Modified Mon Aug 10 14:55:21 2009 UTC (3 years, 9 months ago) by gregory 
Remove duplicate import of protocol module and reorder them.
Revision 1268 - Directory Listing
Modified Mon Aug 10 14:15:28 2009 UTC (3 years, 9 months ago) by gregory 
Avoid partition table log crash the application if node manager and
partition table contents are not consistent.
Revision 1267 - Directory Listing
Modified Mon Aug 10 14:12:09 2009 UTC (3 years, 9 months ago) by gregory 
More checks on functionals tests for storage and cluster part. Cluster tests
reuse methods defined in NEOFunctionalTest class.
Revision 1266 - Directory Listing
Modified Mon Aug 10 13:47:25 2009 UTC (3 years, 9 months ago) by gregory 
Add a timeout on NEOCluster.start().
Revision 1265 - Directory Listing
Modified Mon Aug 10 13:00:05 2009 UTC (3 years, 9 months ago) by gregory 
(Re-) disable by default SQL queries logging.
Revision 1264 - Directory Listing
Modified Mon Aug 10 12:58:56 2009 UTC (3 years, 9 months ago) by gregory 
Fix partition table log method, don't include unused nodes.
Revision 1263 - Directory Listing
Modified Mon Aug 10 12:57:49 2009 UTC (3 years, 9 months ago) by gregory 
Fix test named 'testDropNodeThenRestartCluster', the bug itself is fixed with
commit #1261.
Revision 1262 - Directory Listing
Modified Mon Aug 10 12:54:48 2009 UTC (3 years, 9 months ago) by gregory 
dump() and bin() handle None values.
Revision 1261 - Directory Listing
Modified Mon Aug 10 12:53:44 2009 UTC (3 years, 9 months ago) by gregory 
Erase database content when the node is asked to switch in DOWN_STATE.
Revision 1260 - Directory Listing
Modified Mon Aug 10 12:23:07 2009 UTC (3 years, 9 months ago) by gregory 
Increase column size and change it's type to store UUIDs in hex format.
Revision 1259 - Directory Listing
Modified Mon Aug 10 12:16:34 2009 UTC (3 years, 9 months ago) by gregory 
Storage IDs (UUID, LOID, LPTID) in hex format to help read values stored in
database, copy/paste from sql to command line and so on.
Revision 1258 - Directory Listing
Modified Mon Aug 10 12:08:43 2009 UTC (3 years, 9 months ago) by gregory 
When adding pending nodes, notify them the last OID so they can write it in
their database.
Revision 1257 - Directory Listing
Modified Mon Aug 10 11:30:08 2009 UTC (3 years, 9 months ago) by gregory 
Add a test to check that a dropped node is weel removed from the storage nodes partition
table. This test fail for now, I'm working on a fix.
Revision 1256 - Directory Listing
Modified Mon Aug 10 09:27:24 2009 UTC (3 years, 9 months ago) by vincent 
Document neo.conf.
Extend README to cover installation process more.
Revision 1255 - Directory Listing
Modified Mon Aug 10 09:26:41 2009 UTC (3 years, 9 months ago) by vincent 
Make connector.getConnectorHandler accept None values (returns the default connector).
Make "connector" parameter of client's Sotrage and Application classes optional.
Revision 1254 - Directory Listing
Modified Mon Aug 10 08:30:40 2009 UTC (3 years, 9 months ago) by vincent 
Add a default value for --address parameter.
Revision 1253 - Directory Listing
Modified Mon Aug 10 08:29:31 2009 UTC (3 years, 9 months ago) by vincent 
Remove a duplicate import.
Revision 1252 - Directory Listing
Modified Mon Aug 10 08:25:43 2009 UTC (3 years, 9 months ago) by vincent 
Replace neoctl --ip & --port parameters with a single --address.
Revision 1251 - Directory Listing
Modified Mon Aug 10 07:49:12 2009 UTC (3 years, 9 months ago) by gregory 
Fix mime type on mail body.
Revision 1250 - Directory Listing
Modified Mon Aug 10 07:27:43 2009 UTC (3 years, 9 months ago) by gregory 
Test runner generate the global temporary directory and report import errors.
Revision 1249 - Directory Listing
Modified Fri Aug 7 16:06:16 2009 UTC (3 years, 9 months ago) by vincent 
Add a debug_lock parameter to custom locking class, allowing to turn locks into debugging locks. Thos locks will complain (in a way similar to deadlocks) when acquired twice without being released. This makes it easier to assert execution flow when tracking down a bug.
Revision 1248 - Directory Listing
Modified Fri Aug 7 15:00:35 2009 UTC (3 years, 9 months ago) by gregory 
Importation test need the temp directory, use the good one.
Revision 1247 - Directory Listing
Modified Fri Aug 7 14:57:18 2009 UTC (3 years, 9 months ago) by gregory 
ZODB test instanciate a neo cluster for each test to use a different temporary
directory. Do the same for the testStartWithManyPartitions and fix an unused
parameter on StorageTests.__setup().
Revision 1246 - Directory Listing
Modified Fri Aug 7 14:36:09 2009 UTC (3 years, 9 months ago) by gregory 
Only one temporary directory is used for the test runner, each test method have
it's own directory to easily find related log files. The NeoFunctionalTest class
is added to provide the getTempDirectory() that return the path for the current
test method. Master functional test case now have the neo attribute, all test
cases inherit from NeoFunctionalTest.
Revision 1245 - Directory Listing
Modified Fri Aug 7 13:28:17 2009 UTC (3 years, 9 months ago) by vincent 
Add a test which just starts a cluster with more than 1000 partition (to test partition packet splitting).
Revision 1244 - Directory Listing
Modified Fri Aug 7 11:24:25 2009 UTC (3 years, 9 months ago) by gregory 
Another test for storage, check a node after it replicates data from another that
will shutdown.
Revision 1243 - Directory Listing
Modified Fri Aug 7 09:58:23 2009 UTC (3 years, 9 months ago) by vincent 
Never use a mutable type as named parameters default value.
Revision 1242 - Directory Listing
Modified Fri Aug 7 09:25:17 2009 UTC (3 years, 9 months ago) by gregory 
Suffix cluster state definitions with '_CLUSTER_STATE'
Revision 1241 - Directory Listing
Modified Fri Aug 7 09:17:23 2009 UTC (3 years, 9 months ago) by gregory 
Ignore vim temporary files under neo module.
Revision 1240 - Directory Listing
Modified Fri Aug 7 09:15:34 2009 UTC (3 years, 9 months ago) by gregory 
Fix implementation of setNodeState in master administration handler, it's now
allowed to set a disconnected node to DOWN state and drop it from the partition
table. A global review of node state alteration by the admin node is required to
ensure all and no less-or-more is allowed here. Add a TODO entry about that.
Revision 1239 - Directory Listing
Modified Fri Aug 7 09:12:29 2009 UTC (3 years, 9 months ago) by gregory 
Register testCluster module in test runner.
Revision 1238 - Directory Listing
Modified Fri Aug 7 09:08:53 2009 UTC (3 years, 9 months ago) by gregory 
Add two test for storage side about partition table changes. The second fails
due to a master's administration handler bug.
Revision 1237 - Directory Listing
Modified Fri Aug 7 08:41:46 2009 UTC (3 years, 9 months ago) by gregory 
The protocolError packet is an answer, not a notification, fix this and use an
exception to let the base handler send the packet.
Revision 1236 - Directory Listing
Modified Fri Aug 7 08:33:13 2009 UTC (3 years, 9 months ago) by gregory 
Node state suffix is '_STATE', not '_NODE_STATE', yes this is not consistent
with other enums...
Revision 1235 - Directory Listing
Modified Thu Aug 6 15:42:14 2009 UTC (3 years, 9 months ago) by gregory 
- expectCondition define default values for timeout and delay
- replication check first if all storage are up
- add a test to check that nodes with conflicting UUIDs are rejected.
Revision 1234 - Directory Listing
Modified Thu Aug 6 15:31:16 2009 UTC (3 years, 9 months ago) by gregory 
Master keep the UUID supplied by storage nodes considered as pending. This is no
more an issue with non-empty nodes since commit #1228.
Revision 1233 - Directory Listing
Modified Thu Aug 6 15:29:01 2009 UTC (3 years, 9 months ago) by vincent 
Move sql connection establishment to NEOCluster class, as it requires the knowledge of SQL login & password.
Revision 1232 - Directory Listing
Modified Thu Aug 6 14:55:37 2009 UTC (3 years, 9 months ago) by vincent 
Fix a typo.
Revision 1231 - Directory Listing
Modified Thu Aug 6 14:54:47 2009 UTC (3 years, 9 months ago) by vincent 
Don't be nice to test: it's beter to make them fail early rather than adapt to bogus parameters.
Revision 1230 - Directory Listing
Modified Thu Aug 6 14:53:43 2009 UTC (3 years, 9 months ago) by vincent 
Do not overwrite partition_number with a list.
Revision 1229 - Directory Listing
Modified Thu Aug 6 14:47:58 2009 UTC (3 years, 9 months ago) by gregory 
When changing a node state, broadcast those changes after the partition table
changes because if the node have to be dropped (set in DOWN state), the
partition table update will contains it's UUID after it was removed from the
storages partition table and they will fails to find the related node.
Revision 1228 - Directory Listing
Modified Thu Aug 6 14:44:00 2009 UTC (3 years, 9 months ago) by gregory 
Implement dropPartition() on database manager to remove objects and transactions
not related to partitions currently assigned to a storage node. This is required
because an old node can come back, get a new UUID, start replication and a
conflict on (oid, serial) with the cluster it is joining. As there is now check
on the object integrity, the object will not be replicated and a bad object will
be kept. So during storage initialization, after getting the full partition
table, a storage look if there is partitions unassigned to it and drop data for
those partitions.
Revision 1227 - Directory Listing
Modified Thu Aug 6 14:24:13 2009 UTC (3 years, 9 months ago) by vincent 
Increase the maximum safety margin to 10 seconds, as 5 is not always enough here.
Revision 1226 - Directory Listing
Modified Thu Aug 6 14:23:28 2009 UTC (3 years, 9 months ago) by vincent 
Simplify the neo setup behing testZODB to accelerate it. Complex partition tables should be tested in testStorage.py.
Revision 1225 - Directory Listing
Modified Thu Aug 6 14:22:09 2009 UTC (3 years, 9 months ago) by vincent 
Add a test for partition repartition.
Add a test for partition replication.
Revision 1224 - Directory Listing
Modified Thu Aug 6 13:50:13 2009 UTC (3 years, 9 months ago) by gregory 
Admin node answer noError packet to setNoeState request as it's done to it by
the master node, thus when it forward this answer to neoctl, the expected packet
type is always noError.
Revision 1223 - Directory Listing
Modified Thu Aug 6 13:20:28 2009 UTC (3 years, 9 months ago) by vincent 
Apply commit 1221 to SelectEventManager.
Revision 1222 - Directory Listing
Modified Thu Aug 6 13:15:12 2009 UTC (3 years, 9 months ago) by vincent 
When unregistering a connection, remove it also from the list of connection having pending packets.
Revision 1221 - Directory Listing
Modified Thu Aug 6 13:14:22 2009 UTC (3 years, 9 months ago) by vincent 
Even if a handler raises, the connection might still contain pending packets. So it should not prevent appending the connection to the list.
Revision 1220 - Directory Listing
Modified Thu Aug 6 12:35:54 2009 UTC (3 years, 9 months ago) by vincent 
Add a test file for non-node-specific tests.
Revision 1219 - Directory Listing
Modified Thu Aug 6 11:43:57 2009 UTC (3 years, 9 months ago) by gregory 
Rename getStorage() and getConnection() with 'ZODB' to avoid confusion with NEO
terms. Use them in testImportExport and switch some methods to private
visibility.
Revision 1218 - Directory Listing
Modified Thu Aug 6 11:28:32 2009 UTC (3 years, 9 months ago) by vincent 
Fix erroneous super-class constructor call by using "super" function.
Revision 1217 - Directory Listing
Modified Thu Aug 6 10:16:28 2009 UTC (3 years, 9 months ago) by vincent 
Do not conditionaly define locking classes, so that they can be available independently from VERBOSE_LOCKING value for finer-grained lock tracing.
Revision 1216 - Directory Listing
Modified Thu Aug 6 10:06:08 2009 UTC (3 years, 9 months ago) by gregory 
Add more tests for neo storage side, factorize better the code.
Revision 1215 - Directory Listing
Modified Thu Aug 6 10:05:59 2009 UTC (3 years, 9 months ago) by vincent 
Add a todo about misnamed packets/misassigned packet types.
Revision 1214 - Directory Listing
Modified Thu Aug 6 10:05:10 2009 UTC (3 years, 9 months ago) by gregory 
- Add a stop() method on NeoProcess.
- Add expectCluster<State>() on NeoCluster
- expectNoOutdatedCells renamed as expectOutdatedCells to expect a given number
a cell in OUT_OF_DATE state.
Revision 1213 - Directory Listing
Modified Thu Aug 6 09:55:46 2009 UTC (3 years, 9 months ago) by vincent 
Don't give an answer (0x8000 & above) packet type number to a notification packet.
Revision 1212 - Directory Listing
Modified Thu Aug 6 09:45:07 2009 UTC (3 years, 9 months ago) by gregory 
Forget cluster when reconnecting to primary master.
Revision 1211 - Directory Listing
Modified Thu Aug 6 09:00:12 2009 UTC (3 years, 9 months ago) by gregory 
Fix connection variable name to be removed from the connection pool.
Revision 1210 - Directory Listing
Modified Thu Aug 6 07:30:07 2009 UTC (3 years, 9 months ago) by gregory 
Partial revert of commit #1208, the master connection check must not be global
to the method, raise NotReadyError in each method because the master connection
is not always required.
Revision 1209 - Directory Listing
Modified Wed Aug 5 20:58:08 2009 UTC (3 years, 9 months ago) by gregory 
Fix last partition table ID access, through PT instance instead of app
attribute.
Revision 1208 - Directory Listing
Modified Wed Aug 5 20:05:49 2009 UTC (3 years, 9 months ago) by gregory 
Use a decorator to check if the master connection is well established. Raise
NotReady exception to let the handler dispatch method send the answer.
NotReady can now receive a custom message.
Revision 1207 - Directory Listing
Modified Wed Aug 5 19:32:31 2009 UTC (3 years, 9 months ago) by gregory 
Set the uuid supplied on command line after the configuration is loaded.
Revision 1206 - Directory Listing
Modified Wed Aug 5 19:31:04 2009 UTC (3 years, 9 months ago) by gregory 
Remove useless print statements.
Revision 1205 - Directory Listing
Modified Wed Aug 5 19:30:28 2009 UTC (3 years, 9 months ago) by gregory 
Add a FIXME on the master administration handler about an issue with the 'drop'
neoctl command on disconnected nodes.
Revision 1204 - Directory Listing
Modified Wed Aug 5 19:11:17 2009 UTC (3 years, 9 months ago) by gregory 
Storage functional tests use getStorage() defined on NeoCluster. Add
getConnection().
Revision 1203 - Directory Listing
Modified Wed Aug 5 18:37:30 2009 UTC (3 years, 9 months ago) by gregory 
The test runner notice when it fails to send the report by mail.
Revision 1202 - Directory Listing
Modified Wed Aug 5 16:20:13 2009 UTC (3 years, 9 months ago) by vincent 
Merge and simplify admin handler classes to hanle just 2 cases: expected answer, and the rest. This fixes cluster state notification handling (which used to only log a line because the hadler method was defined twice...).
Revision 1201 - Directory Listing
Modified Wed Aug 5 15:57:14 2009 UTC (3 years, 9 months ago) by gregory 
Add a second test for storage replication, factorise the first and add an helper
in NeoCluster class.
Revision 1200 - Directory Listing
Modified Wed Aug 5 15:17:05 2009 UTC (3 years, 9 months ago) by vincent 
Add killStorage and expectClusterState methods.
Revision 1199 - Directory Listing
Modified Wed Aug 5 14:42:18 2009 UTC (3 years, 9 months ago) by gregory 
Genericize expectMasterState(), wait after a kill() in __del__.
Revision 1198 - Directory Listing
Modified Wed Aug 5 14:09:38 2009 UTC (3 years, 9 months ago) by gregory 
Move expect* helpers from testMaster.
Revision 1197 - Directory Listing
Modified Wed Aug 5 14:05:59 2009 UTC (3 years, 9 months ago) by vincent 
The existing code was exiting election loop too early, as there might not have been an identified connection to primary master (ask/answerPrimaryMaster is quicker than ask/answerPrimaryMaster + request/acceptNodeIdentification).
The correct way is to stop waiting for connections to nodes other than primary master, and this can be done in answerPrimaryMaster.
Revision 1196 - Directory Listing
Modified Wed Aug 5 14:02:15 2009 UTC (3 years, 9 months ago) by vincent 
Fix a forgotten getPrimaryMaster call on self.
Revision 1195 - Directory Listing
Modified Wed Aug 5 14:01:49 2009 UTC (3 years, 9 months ago) by vincent 
Add more node state checks.
Revision 1194 - Directory Listing
Modified Wed Aug 5 13:49:42 2009 UTC (3 years, 9 months ago) by vincent 
No need to cleanum NodeManager content when connection to primary master is closed, since we will anyway flush it when trying to reconnect to a primary master.
Revision 1193 - Directory Listing
Modified Wed Aug 5 13:48:49 2009 UTC (3 years, 9 months ago) by vincent 
Change primary master state to RUNNING, as we are indeed connected to it (and it won't notify of its own state).
Revision 1192 - Directory Listing
Modified Wed Aug 5 13:47:12 2009 UTC (3 years, 9 months ago) by vincent 
Add a new Node state: UNKNOWN_STATE. In this state, nodes are supposed to be RUNNING, but there was no successful attemp to connect to them yet, nor any notification that they were running. This is especially useful in tests to avoid a stopped node to appear as RUNNING until receiving a notification that it is in fact DOWN.
Revision 1191 - Directory Listing
Modified Wed Aug 5 13:46:45 2009 UTC (3 years, 9 months ago) by gregory 
Move some helper functions from testMaster to functional module to be resused by
others test cases.
Revision 1190 - Directory Listing
Modified Wed Aug 5 13:27:10 2009 UTC (3 years, 9 months ago) by gregory 
Reset process pid when killed, allow start the cluster without some storage
processes.
Revision 1189 - Directory Listing
Modified Wed Aug 5 12:55:01 2009 UTC (3 years, 9 months ago) by vincent 
Make all election handler classes inherit from ElectionHandler: master will send a notification to all nodes that a new master appeared, which includes the new master itself, so it must expect a NotifyNodeInformation packet.
Revision 1188 - Directory Listing
Modified Wed Aug 5 12:11:16 2009 UTC (3 years, 9 months ago) by gregory 
Update tests runner to report failed imports and include new functional tests.
Revision 1187 - Directory Listing
Modified Wed Aug 5 11:51:23 2009 UTC (3 years, 9 months ago) by gregory 
Fix boolean condition is NodeManager.clear()
Revision 1186 - Directory Listing
Added Wed Aug 5 10:02:51 2009 UTC (3 years, 9 months ago) by gregory 
Add a functional test for storage side.
  ViewVC Help
Powered by ViewVC 1.1.2