summaryrefslogtreecommitdiffstats
path: root/tool
Commit message (Collapse)AuthorAgeFilesLines
* * transcode_data.h (rb_transcoder_stateful_type_t): defined.akr2008-08-151-0/+1
| | | | | | | | | | | | | | | | | (rb_transcoder): add field: stateful_type. * tool/transcode-tblgen.rb: generate stateful_type field as stateless_converter. * enc/trans/iso2022.trans: follow rb_transcoder change. * enc/trans/newline.trans: ditto. * enc/trans/utf_16_32.trans: ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18650 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * include/ruby/encoding.h (rb_econv_output): declared.akr2008-08-141-1/+2
| | | | | | | | | | | | | | | | | | * transcode_data.h (rb_transcoder): add resetsize_func field. * enc/trans/iso2022.trans (iso2022jp_reset_sequence_size): defined. (rb_EUC_JP_to_ISO_2022_JP): provede resetsize_func. * tool/transcode-tblgen.rb: set NULL for resetsize_func. * transcode.c (rb_econv_output): new function for inserting output. (output_replacement_character): use rb_econv_output. (transcode_loop): check return value of output_replacement_character. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18628 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb: check unexpected actions.akr2008-08-141-1/+3
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18619 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: fix for clean up.nobu2008-08-131-9/+11
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18553 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: try to find exported directory.nobu2008-08-131-3/+8
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18550 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: fix for enc.mk.nobu2008-08-121-28/+61
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18542 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb (#transcode_tblgen): slight messagematz2008-08-121-1/+1
| | | | | | improvement. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18529 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode_data.h (TRANSCODE_ERROR): removed.akr2008-08-121-2/+4
| | | | | | | | | | | * tool/transcode-tblgen.rb: 8bit byte of ASCII-8BIT is a valid (but unique to ASCII-8BIT) character. * transcode.c (rb_eConversionUndefined): new error. (rb_eInvalidByteSequence): ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18524 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode_data.h (rb_transcoder): add resetstate_func field forakr2008-08-111-1/+1
| | | | | | | | | | | | | | | | resetting a state of stateful encoding. * enc/trans/iso2022.trans (rb_EUC_JP_to_ISO_2022_JP): specify finish_eucjp_to_iso2022jp for resetstate_func. * tool/transcode-tblgen.rb: specify NULL for resetstate_func. * transcode.c (output_replacement_character): call resetstate_func before appending the replacement character. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18503 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/iso2022.trans: renamed from iso2022.erb.c.akr2008-08-111-7/+7
| | | | | | | | | | | | | | | | | | | * enc/trans/single_byte.trans: ditto. * enc/trans/utf_16_32.trans: ditto. * enc/trans/korean.trans: ditto. * enc/trans/japanese.trans: ditto. * enc/depend: follow the renaming. * tool/build-transcode: ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18488 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb: record checksum ofakr2008-08-101-2/+6
| | | | | | | transcode-tblgen.rb itself. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18473 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/Makefile.in (make-workdir): use MAKEDIRS.nobu2008-08-101-1/+3
| | | | | | | | | * enc/depend: makes target directory before compile/link. * tool/transcode-tblgen.rb: creates target directory. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18469 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode_data.h (rb_transcoding): add fields for restartable akr2008-08-091-5/+30
| | | | | | | | | | | | | | | | | | | | | | transcoding. (rb_transcoder): add max_input field. from_unit_length field is renamed to input_unit_length. * tool/transcode-tblgen.rb: generate max_input field. * enc/trans/iso2022.erb.c: follow rb_transcoder change. * enc/trans/utf_16_32.erb.c: ditto. * transcode.c (PARTIAL_INPUT): new constant. (transcode_char_start): new function. (transcode_result_t): new type. (transcode_restartable): new function. (more_output_buffer): new function. (transcode_loop): use transcode_restartable. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18452 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode_data.h (rb_transcoder): from_unit_length field added.akr2008-08-081-20/+33
| | | | | | | | | | | | | | | | | | | | from_utf8 field removed. * tool/transcode-tblgen.rb: generate offsets range. follow rb_transcoder change. * transcode.c (transcode_loop): don't use from_utf8. make invalid region from_unit_length wise. * enc/trans/iso2022.erb.c: follow rb_transcoder and transcode_generate_node change. * enc/trans/utf_16_32.erb.c: follow rb_transcoder and transcode_generate_node change. explicit :invalid map removed. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18445 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode_data.h (rb_transcoding): new field "stateful".akr2008-08-071-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (rb_transcoder): preprocessor and postprocessor field removed. change arguments of func_ii, func_si, func_io and func_so. new field "finish_func". * tool/transcode-tblgen.rb: make FUNii, FUNsi and FUNio generatable. * transcode.c (transcoder_lib_table): removed. (transcoder_table): change structure. (transcoder_key): removed because the above structure change. (make_transcoder_entry): new function. (get_transcoder_entry): ditto. (rb_register_transcoder): follow the structure change. (declare_transcoder): ditto. (transcode_search_path): new function for breadth first search to find a list of converters. (transcode_search_path_i): new function. (transcode_dispatch_cb): ditto. (transcode_dispatch): use transcode_search_path. (transcode_loop): follow the argument change. (str_transcode): preprocessor and postprocessor stuff removed. * enc/trans/iso2022.erb.c: new file. ISO-2022-JP conversion re-implemented. * enc/trans/japanese.erb.c: ISO-2022-JP stuff removed. nute(23:52:53)% head -40 ChangeLog Thu Aug 7 23:43:11 2008 Tanaka Akira <akr@fsij.org> * transcode_data.h (rb_transcoding): new field "stateful". (rb_transcoder): preprocessor and postprocessor field removed. change arguments of func_ii, func_si, func_io and func_so. new field "finish_func". * tool/transcode-tblgen.rb: make FUNii, FUNsi and FUNio generatable. * transcode.c (transcoder_lib_table): removed. (transcoder_table): change structure. (transcoder_key): removed because the above structure change. (make_transcoder_entry): new function. (get_transcoder_entry): ditto. (rb_register_transcoder): follow the structure change. (declare_transcoder): ditto. (transcode_search_path): new function for breadth first search to find a list of converters. (transcode_search_path_i): new function. (transcode_dispatch_cb): ditto. (transcode_dispatch): use transcode_search_path. (transcode_loop): follow the argument change. (str_transcode): preprocessor and postprocessor stuff removed. * enc/trans/iso2022.erb.c: new file. ISO-2022-JP conversion re-implemented. * enc/trans/japanese.erb.c: ISO-2022-JP stuff removed. * enc/trans/utf_16_32.erb.c: follow argument change of FUNso. [ruby-dev:35798] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18419 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb (transcode_generate_node): codeakr2008-08-061-1/+3
| | | | | | | argument removed. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18395 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb: distinguish UNDEF and INVALID.akr2008-08-061-114/+120
| | | | | | | | | [ruby-dev:35709] * transcode.c (transcode_loop): don't need rb_enc_mbclen now. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18390 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb (ActionMap#eql?): use == to compare @map.akr2008-08-051-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18383 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/transcode-tblgen.rb: show generating tables in verbose mode.akr2008-08-051-4/+12
| | | | | | | | | | (transcode_generate_node): call ActionMap#generate_node with showing table name. * enc/trans/utf_16_32.erb.c: use transcode_generate_node. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18382 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (transcodes), tool/build-transcode: generates transcodenobu2008-08-051-4/+14
| | | | | | | | | | sources. * enc/trans/{japanese,korean,single_byte,utf_16_32}.c: to be autogenerated now. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18376 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/build-transcode: new file.akr2008-08-052-0/+571
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tool/transcode-tblgen.rb: new file. * enc/trans/make_transdb.rb: exclude *.erb.c. * enc/depend: exclude *.erb.c. * enc/trans/utf_16_32.erb.c: new file. * enc/trans/single_byte.erb.c: new file. * enc/trans/japanese.erb.c: new file. * enc/trans/korean.erb.c: new file. * enc/trans/iso-8859-2-tbl.rb: new file. * enc/trans/iso-8859-3-tbl.rb: new file. * enc/trans/iso-8859-4-tbl.rb: new file. * enc/trans/iso-8859-5-tbl.rb: new file. * enc/trans/iso-8859-6-tbl.rb: new file. * enc/trans/iso-8859-7-tbl.rb: new file. * enc/trans/iso-8859-8-tbl.rb: new file. * enc/trans/iso-8859-9-tbl.rb: new file. * enc/trans/iso-8859-10-tbl.rb: new file. * enc/trans/iso-8859-11-tbl.rb: new file. * enc/trans/iso-8859-13-tbl.rb: new file. * enc/trans/iso-8859-14-tbl.rb: new file. * enc/trans/iso-8859-15-tbl.rb: new file. * enc/trans/eucjp-tbl.rb: new file. * enc/trans/sjis-tbl.rb: new file. * enc/trans/euckr-tbl.rb: new file. * enc/trans/utf_16_32.c: regenerated. * enc/trans/single_byte.c: regenerated. * enc/trans/japanese.c: regenerated. * enc/trans/korean.c: regenerated. [ruby-dev:35730] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@18373 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/instruction.rb: RubyVM is not module.ko12008-07-011-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17776 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * compile.c, insns.def, vm.c, vm_core.h: remove some insnsko12008-07-011-1/+1
| | | | | | | | | | | | (undef, alias, definemethod). Call RubyVM::FrozenCore's singleton method instead. Add "putiseq" and "putspecialobject" instructions. * id.c, id.h: add ids for above. * tool/parse.rb: "VM" no longer exists. Use RubyVM instead. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17755 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: ported to ruby.nobu2008-06-211-97/+135
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17495 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: fixed digets.nobu2008-06-201-7/+6
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17494 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: do not use sha256sum; use BASERUBY insteadshyouhei2008-06-201-5/+10
| | | | | | | * common.mk (dist): use tool/make-snapshot instead git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17491 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: fixed typo.nobu2008-06-201-2/+3
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17467 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: supported multiple snapshots.nobu2008-06-191-22/+84
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@17431 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * vm_core.h (rb_num_t): moved form vm.h.nobu2008-05-231-5/+9
| | | | | | | | | * tool/instruction.rb (RubyVM::Instruction#sp_increase_c_expr), tool/instruction.rb (RubyVM::VmBodyGenerator#make_header_operands): omit unused variables. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@16551 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/compile_prelude.rb: allows extra suffix after .c.nobu2008-04-061-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15910 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * compile.c (iseq_set_sequence, iseq_insns_unification,nobu2008-04-031-3/+3
| | | | | | | | | | | | | insn_data_to_s_detail): constified. * iseq.c (insn_operand_intern, ruby_iseq_disasm_insn): ditto. * template/{insns_info,opt_sc,optunifs}.inc.tmpl: ditto. * tool/instruction.rb (OptUnifsIncGenerator): ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15889 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: prefixed r makes $revision always true.nobu2008-03-011-2/+2
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15661 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: make prereq uses MINIRUBY.matz2008-03-011-4/+4
| | | | | | | * tool/make-snapshot: allow packaging like 1.9.0-1 by second command-line argument. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15659 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/compile_prelude.rb (C_ESC): use octal escape to avoidakr2008-02-011-2/+2
| | | | | | | "\x09for (;;) ..." to be interpret the first character 0x9f. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15361 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/ifchange: remove $temp when unchanged.naruse2008-01-291-0/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15312 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/ifchange: commit miss.nobu2008-01-251-0/+16
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@15235 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/ytab.sed: skip yydestruct hack unless yymsg exists, for bisonnobu2007-12-281-1/+1
| | | | | | | 1.8 series. [ruby-dev:32825] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14750 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * insns2vm.rb: add encoding option to shbang.ko12007-12-251-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14703 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: add version number.nobu2007-12-251-4/+6
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14700 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (parse.c): depends on tool/ytab.sed.nobu2007-12-251-1/+21
| | | | | | | * tool/ytab.sed: hack for bison 2.1. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14697 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: argument check, and cleanup exported directory.nobu2007-12-251-0/+5
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14695 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: more portable.eban2007-12-251-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14694 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot (revision): sed does not support +.nobu2007-12-251-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14693 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * trunk/common.mk, goruby.c, golf_prelude.rb: for golfers.nobu2007-12-251-1/+2
| | | | | | | | | * trunk/main.c (main): hook for embedding applications. * trunk/tool/compile_prelude.rb: can change initialize function name. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14676 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/make-snapshot: must create configure and lex.c.eban2007-12-241-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14627 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/compile.rb, getrev.rb, runruby.rb: remove unused tools.ko12007-12-243-84/+0
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14580 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/serb.rb: removed.akr2007-12-241-17/+0
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14577 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (encs, ext/ripper/ripper.c): needs MFLAGS.nobu2007-12-221-0/+31
| | | | | | | | | | | | | | * configure.in (STRINGIZE): stringizing macro. * include/ruby/defines.h (STRINGIZE): fallback. * tool/make-snapshot: new file. * version.c (ruby_description, ruby_copyright): string constants for -v option. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14469 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/insns2vm.rb: moved from lib/vm/instruction.rb.ko12007-12-222-1/+1382
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14451 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/insns2vm.rb: set property.nobu2007-12-221-0/+0
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@14449 b2dd03c8-39d4-4d8f-98ff-823fe69b080e