summaryrefslogtreecommitdiffstats
path: root/server/parser
Commit message (Collapse)AuthorAgeFilesLines
* Moved PostgreSQL related array function into pgsql.cDavid Sommerseth2011-10-073-55/+77
| | | | | | | | This is to put all PostgreSQL related functions in one place. Using the init_xmlparser() the function needed to format arrays are provided to the xmlparser code paths. Signed-off-by: David Sommerseth <davids@redhat.com>
* Introduce init_xmlparser() processDavid Sommerseth2011-10-072-0/+50
| | | | | | | This is the first step towards moving PostgreSQL specific parts out of xmlparser.c to make the xmlparser database backend agnostic. Signed-off-by: David Sommerseth <davids@redhat.com>
* Added support for PostgreSQL arrays + store cpu_topology CPU spread as an arrayDavid Sommerseth2011-10-072-5/+109
| | | | | | | | Implemented a new value type for the internal <sqldata/> XML format, which will store data in an PostgreSQL array. This is used now to store the CPU core spread of the socket in a sepearate field in rtevalruns_details. Signed-off-by: David Sommerseth <davids@redhat.com>
* Moved annotation data into a separate table field in rtevalruns_detailsDavid Sommerseth2011-01-101-2/+4
| | | | Signed-off-by: David Sommerseth <davids@redhat.com>
* Added --annotate | -a feature to rtevalDavid Sommerseth2010-04-121-1/+1
|
* Added support for num_cpu_sockets and improved num_cpu_cores extractionDavid Sommerseth2010-04-011-3/+16
| | | | | | This change will support both the new <cpu_topology/> tag and the old <cpu_cores/> tag. Added extraction of data for the rtevalruns_details.num_cpu_sockets field as well.
* Added basic info for more CPU topology infoDavid Sommerseth2010-03-311-11/+16
| | | | | | | Have not yet implemented extraction new cpu_topology tags, but the summary of this information will go into the num_cpu_cores and num_cpu_sockets fields in the database. Right now it only takes the /rteval/hardware/cpu_cores and puts it into num_cpu_cores
* Added storing NUMA nodes in to rtevalruns_detailsDavid Sommerseth2010-03-261-3/+5
|
* Improved general parse loggingDavid Sommerseth2010-03-262-17/+23
| | | | | Logs now show which thread and more clearly which submid record which is being parsed. Also added a log message when the parsing is completed.
* Changed snprintf() to append_str() when adding 'AND ipaddr' SQL stringDavid Sommerseth2010-03-261-2/+4
|
* Make sure we search for IP address == NULL when the input is NULLDavid Sommerseth2010-03-251-0/+2
|
* Honour the 'isnull' attribute in <value/> tagsDavid Sommerseth2010-03-251-2/+7
|
* Don't consider IP address if the value is NULL when looking up registered ↵David Sommerseth2010-03-251-2/+7
| | | | systems
* Updated the README files to reflect recent changesDavid Sommerseth2010-03-251-14/+43
|
* Added support for storing Linux distro in the databaseDavid Sommerseth2010-03-251-1/+3
|
* Cleaned up xmlparser.xsl - avoid not needed <xsl:apply-templates/> callsDavid Sommerseth2010-03-231-170/+146
|
* Renamed rteval_parserd to rteval-parserdDavid Sommerseth2010-03-228-29/+29
|
* Fixed rpmlint complaintsDavid Sommerseth2010-03-221-6/+10
|
* Copy init script and config file example to the docs dir on 'make install'David Sommerseth2010-03-221-0/+4
|
* Added initial init.d script and sysconfig file for rteval_parserdDavid Sommerseth2010-03-192-0/+145
|
* Updated README files for the XMLRPC server to match latest changesDavid Sommerseth2009-12-081-0/+17
| | | | (cherry picked from commit d1e70546375f08c8ce0dc7730f671be371be2c2a)
* Avoid unexpected exit if the main thread starts process_submission_queue() ↵David Sommerseth2009-12-081-0/+1
| | | | | | | | | | | | too early If the process_submission_queue() function in the main thread is started before the parsethread() based threads, the number of active threads will be 0 and process_submission_queue() will immediately send a "shutdown" message and exit. The quick solution is to sleep 3 seconds before starting the process_submission_queue() job. This way at least a few of the parsethread() threads should have had time to start up and setle.
* Updated the SQL database schema and XML parser stylesheetDavid Sommerseth2009-12-081-7/+11
| | | | | | | | | | | | - This database schema introduces the rteval_info table which should contain rather static information about the current rteval installation. - New data fields from cyclictest are introduces (variance and mean_abs_dev) - Added //sqldata/@schemaver attributes to all defined tables in xmlparser.xsl - Introduced a delta-1.0_1.1.sql file which will update the old 1.0 based database schema to the new 1.1 version.
* Implemented SQL schema version handling on the database layerDavid Sommerseth2009-12-082-4/+41
| | | | | | | | | | | | When a database connection is established, the rteval_info table is queried for a key/value pair named 'sql_schema_ver' and parsed. This attribute defines which version the rteval database schema is in use. When processing XML documents with <sqldata/>, a checks is done to make sure there are no attempts on inserting data to an incompatible rteval database schema. If the rteval_info table or the sql_schema_ver value is not found, it will default to version 1.0 (the parsed int value will be 100)
* Added function to extract and parse the new //sqldata/@schemaver attributeDavid Sommerseth2009-12-082-0/+32
| | | | | | This attribute defines which version of the SQL database schema which is needed for the SQL data found in the <sqldata/> document. This is to avoid SQL failures when inserting data which the database is not prepared for.
* Changed the complete autotools setup for rteval-xmlrpcDavid Sommerseth2009-12-035-1252/+0
| | | | | | | | | | | - Rewrote the complete autotools setup for rteval server to also include the XMLRPC interface - Compiles and installs both the Python files needed for Apache+mod_python and the files needed for the rteval_parserd - ./configure accepts --with-xmlrpc-webroot to set the directory of the XML-RPC files needed for mod_python. If this is not set, those files will not be installed. - Moved the sql/rteval-1.0.sql file into the server directory, where it is needed and install this file into the doc directory
* Cleaned up and fixed configure.ac issuesDavid Sommerseth2009-11-101-17/+48
| | | | | Now header files are detected correctly and all functions tested are tested properly
* Updated README with info about new config parameters ++David Sommerseth2009-11-101-6/+23
|
* Cleaned up eFree_values() even moreDavid Sommerseth2009-11-101-18/+7
|
* Avoid recursion calls in do_free_vals()David Sommerseth2009-11-101-6/+11
|
* Simplified the API to parse_report() and check_filesize()David Sommerseth2009-11-101-41/+35
| | | | | Passing threadData_t * directly, instead of several individual parameters deriving from a threadData_t pointer.
* Corrected commentsDavid Sommerseth2009-11-101-2/+4
|
* Cosmetic fixDavid Sommerseth2009-11-101-1/+1
|
* Fixed a misleading log message during shutdown and a tiny memleakDavid Sommerseth2009-11-101-3/+2
|
* Added new config parameter: max_report_sizeDavid Sommerseth2009-11-106-7/+55
| | | | | | | | | | | | To avoid potential DoS attacks by sending big XML files, the max_report_size rejects reports which is bigger than this value. The default value is 2MB if this value is not configured. A new status code was introduced, STAT_FTOOBIG (12). The submissionqueue record will be updated with this value on records which fails this check. In addition minor SIGSEGV failure was fixed when rteval_parserd shutsdown before worker threads have really started.
* Fixed potential thread collision with oid return valuesDavid Sommerseth2009-11-101-3/+4
|
* autotoolised rteval_parserdDavid Sommerseth2009-11-055-13/+1266
|
* Cleaned up the XML-RPC serverDavid Sommerseth2009-10-261-0/+289
| | | | | | Removed code not needed any more and updated README with correct information. This is all connected to the introduction of the rteval_parserd process, which is found in ./parser.
* Fixed a memory leak introduced in commit 70c850c13dabed16a69bDavid Sommerseth2009-10-231-0/+1
|
* Get rid of the sleep() calls and use blocking POSIX MQ callsDavid Sommerseth2009-10-232-12/+41
| | | | | This way, the rteval_parserd will also shutdown almost instantly unless one of the threads are in the progress of parsing a report.
* Improved robustness of database connections and thread controlDavid Sommerseth2009-10-233-19/+88
| | | | | | | | | | | | | | | | | Both the process_submission_queue() and parserthread() functions now make use of db_ping() to make sure they have an alive database connection. And if not, trigger the needed notifications. If the process_submission_queue() looses the database connection completely, it will shutdown rteval_parserd immediately. If the parserthread()s looes the database connection, it will reduce the activethreads counter. And if this counter reaches 0, it will signal the main thread which initiates a complete shutdown of rteval_parserd. Btw. db_ping() will indeed try to restore the database connection before presuming the database is unavailable.
* Added db_ping() function and made db_wait_notification() more solidDavid Sommerseth2009-10-232-0/+49
|
* Added READMEDavid Sommerseth2009-10-221-0/+134
|
* Added simple Makefile, before it's automated completelyDavid Sommerseth2009-10-221-0/+13
|
* Fixed doxygen errorsDavid Sommerseth2009-10-229-13/+55
|
* Added daemonising of the processDavid Sommerseth2009-10-221-12/+80
| | | | | And fixed an error when the program exits before POSIX MQ queue is opened and initialised.
* If logging to file, fflush() on each writelog() callDavid Sommerseth2009-10-221-0/+4
|
* Make use of the 'threads' config/argument settingDavid Sommerseth2009-10-221-1/+7
|
* Added --help|-h with usage info, added missing --threads|-t argumentDavid Sommerseth2009-10-221-7/+67
|
* Implemented argument parsingDavid Sommerseth2009-10-223-9/+25
|