summaryrefslogtreecommitdiffstats
path: root/transcode.c
Commit message (Collapse)AuthorAgeFilesLines
* * transcode_data.h, transcode.c, tool/transcode-tblgen.rb: Addedduerst2009-12-101-0/+26
| | | | | | | | | | | | support for new transcoding instruction FUNsio (with Tatsuya Mizuno) * enc/trans/gb18030.trans: Significantly reduced GB18030 conversion table footprint using FUNsio and differences (with Tatsuya Mizuno) * test/ruby/test_transcode.rb: Minor name fix (from Tatsuya Mizuno) git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@26065 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * removed spaces just before tabs.nobu2009-11-261-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25930 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c: Added a check for an internal errorduerst2009-11-251-0/+2
| | | | | | | (with Tatsuya Mizuno) git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25919 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* fix typos.akr2009-11-031-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25635 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_transcoding, str_transcoding_resize): fixednobu2009-10-101-29/+32
| | | | | | | types. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25289 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c: reverted r25277.nobu2009-10-101-32/+29
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25288 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_transcoding, str_transcoding_resize): fixednobu2009-10-101-29/+32
| | | | | | | types. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25277 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (econv_data_type): typed.nobu2009-09-091-13/+22
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@24810 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_encode_bang): C99ism.usa2009-07-311-2/+5
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@24335 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c: added check for frozen string for encode! (see Bug #1836)duerst2009-07-301-0/+4
| | | | | | | * test/ruby/test_transcode.rb: added tests for the above git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@24322 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (enc_arg): default interanl encoding may not be set.nobu2009-06-211-2/+2
| | | | | | | [ruby-core:23932] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23773 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * array.c (rb_ary_memsize): added.ko12009-06-161-0/+40
| | | | | | | | | | | | * io.c (rb_io_memsize): added. * regcomp.c (onig_memsize): added. * string.c (rb_str_memsize): added. * transcode.c (rb_transcoding_memsize, rb_econv_memsize): added. * variable.c (rb_geneic_ivar_memsize): added. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23714 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_restartable0): refix can't build with VC9.naruse2009-06-161-9/+14
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23703 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_restartable0): revert last commit becauseko12009-06-141-10/+9
| | | | | | | | this change cause SEGV at test-all. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23690 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_restartable0): can't build with VC9.naruse2009-06-131-9/+10
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23685 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Fix rdoc.naruse2009-06-131-5/+5
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23682 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * encoding.c (rb_enc_codepoint_len): combine rb_enc_codepoint()matz2009-05-191-1/+1
| | | | | | | | | | | | | | | | | | | and rb_enc_codelen() in one function to reduce calls. * encoding.c (rb_enc_codepoint): compatibility function. * sprintf.c (rb_str_format): use rb_enc_codepoint_len(). * string.c (rb_str_inspect, rb_str_upcase_bang, rb_str_downcase_bang, rb_str_capitalize_bang, rb_str_swapcase_bang, trnext, tr_trans, rb_str_delete_bang, rb_str_squeeze_bang, rb_str_count, rb_str_split_m, rb_str_each_line, rb_str_each_codepoint, rb_str_lstrip_bang, sym_printable): ditto. * transcode.c (make_econv_exception): use rb_enc_mbc_to_codepoint() git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23493 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Fix: DON'T move in_p because before in_p is replaced by buffered data.naruse2009-05-051-8/+6
| | | | | | | | | | | | | | | | * transcode.c: NOMAP is now multibyte direct map. * transcode.c: remove ASIS. * transcode_data.h: ditto. * tool/transcode-tb (ActionMap#generate_info): remove :asis. * tool/transcode-tb (ActionMap#generate_info): add :nomap0. * enc/trans/utf8_mac.trans: replace :asis by :nomap0. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23344 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (ASIS): added for multi byte direct map.naruse2009-04-261-2/+11
| | | | | | * transcode.c (transcode_restartable0): ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23294 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * array.c, bignum.c, dln.c, error.c, gc.c, io.c, marshal.c,nobu2009-03-121-4/+4
| | | | | | | | | | numeric.c, pack.c, strftime.c, string.c, thread.c, transcode.c, transcode_data.h, util.c, variable.c, vm_dump.c, include/ruby/encoding.h, missing/crypt.c, missing/vsnprintf.c: suppress VC type warnings. [ruby-core:22726] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@22914 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* stripped trailing spaces.nobu2009-02-221-10/+10
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@22552 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (make_econv_exception): refine error message forakr2009-02-041-9/+19
| | | | | | | | undefined conversion. [ruby-core:21828] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@22049 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (make_econv_exception): show U+XXXX form for undefinedakr2009-02-041-2/+16
| | | | | | | conversion error from UTF-8. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@22039 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_econv_init_by_convpath_i): make it static.akr2009-01-291-1/+2
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21883 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (struct rb_transcoding): added ary member for debug.nobu2009-01-271-2/+2
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21789 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_transcode0): fix: :xml option doesn'tnaruse2009-01-181-1/+2
| | | | | | work on str.encode([options]) form without default_internal. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21649 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Add rdoc.naruse2009-01-151-1/+5
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21532 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/gb18030.trans, gb18030-tbl.rb:duerst2009-01-141-4/+14
| | | | | | | | | | | | | | | new Chinese GB18030 transcoding (from Yoshihiro Kambayashi) * test/ruby/test_transcode.rb: added tests for the above (from Yoshihiro Kambayashi) * transcode_data.h, transcode.c, tool/transcode_tblgen.rb: added support for GB18030-specific 4-byte sequences (with Yoshihiro Kambayashi) git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21509 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Add dummy definition for fake rdoc.naruse2009-01-131-0/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21488 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c: Minor fixes and tweaks in documentation.duerst2008-12-301-76/+85
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21187 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (make_econv_exception): show source and destinationakr2008-12-271-0/+8
| | | | | | | encoding. [ruby-dev:37285] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21092 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * io.c (fptr_finalize): close the IO object even if finish_writeconv orakr2008-12-261-0/+6
| | | | | | | | | | | | | | | flush is failed. (finish_writeconv): don't raise. return errno or exception. (finish_writeconv_arg): removed. (finish_writeconv_sync): follow finish_writeconv change. * transcode.c (rb_econv_make_exception): new function. * include/ruby/encoding.h (rb_econv_make_exception): declared. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21059 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_transcode0): set encoding when String#encode wasnaruse2008-12-251-2/+2
| | | | | | given explicit but the same destination and source encoding. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21047 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (sym_ignore): remove useless symbol.naruse2008-12-251-2/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@21044 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (decorate_convpath): show type of escaping fornaruse2008-12-251-11/+16
| | | | | | xml_attr_quote or some conversions. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@20991 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * io.c: rdoc for File::open and 1.9 feature in file modes.yugui2008-12-231-2/+25
| | | | | | * transcode.c: rdoc for String#encode git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@20946 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c: in transcode_search_path, elimintated a warningduerst2008-10-181-5/+2
| | | | | | | on cygwin about pathlen potentially not being initialized git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19830 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_transcode0): String#encode without argument nowmatz2008-10-171-16/+16
| | | | | | | | | behave as if :undef => :replace, :invalid => :replace specified. * transcode.c (rb_econv_prepare_opts): should preserve options in any case. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19818 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_restartable0): in_pos and out_pos never beakr2008-10-161-13/+0
| | | | | | | NULL, now. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19810 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_transcode0): should not raise error whenmatz2008-10-141-1/+1
| | | | | | default_internal is not set. [ruby-core:19309] git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19784 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_econv_init_by_convpath): suppressed warnings.nobu2008-10-131-1/+1
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19769 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (str_transcode0): String#encode() with no encodingmatz2008-10-121-4/+15
| | | | | | | specified transcode the string into Encoding.default_internal. inspired by [ruby-core:19298]. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19764 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_econv_add_coverter): remove unnecessary NULL check.mame2008-10-091-2/+0
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19733 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * include/ruby/encoding.h (rb_str_encode): renamed fromakr2008-09-261-3/+3
| | | | | | | | | | | | | rb_str_transcode. [ruby-dev:36593] (rb_econv_has_convpath_p): renamed from rb_transcode_convertible. * transcode.c: follow the renaming. * io.c: ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19589 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * error.c (Init_Exception): introduce EncodingError which is amatz2008-09-261-3/+3
| | | | | | | | | superclass for all encoding related exception classes, e.g. Encoding::CompatibilityError. [ruby-dev:36371] * transcode.c (Init_transcode): ditto. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19570 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c, include/ruby/encoding.c (rb_transcode_convertible):usa2008-09-261-0/+14
| | | | | | | | new function. checking the existance of converter. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19565 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* update rdoc.akr2008-09-251-12/+12
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19558 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (rb_eUndefinedConversionError): renamed fromakr2008-09-251-18/+18
| | | | | | | | | rb_eConversionUndefinedError. (rb_eConverterNotFoundError): renamed from rb_eNoConverterError. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19554 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* update rdoc.akr2008-09-251-10/+54
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19551 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* update rdoc.akr2008-09-241-0/+5
| | | | git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@19532 b2dd03c8-39d4-4d8f-98ff-823fe69b080e