ruby.git/enc/trans, branch master

* transcode_data.h, transcode.c, tool/transcode-tblgen.rb: Added

2009-12-10T11:59:12+00:00

  support for new transcoding instruction FUNsio (with Tatsuya Mizuno)

* enc/trans/gb18030.trans: Significantly reduced GB18030 conversion
  table footprint using FUNsio and differences (with Tatsuya Mizuno)

* test/ruby/test_transcode.rb: Minor name fix (from Tatsuya Mizuno)


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@26065 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/gb18030-tbl.rb: Fix omission of C1 region in code table

2009-12-03T11:29:33+00:00

  (from Tatsuya Mizuno)

* test/ruby/test_transcode.rb: Added test for converting full range of
  Unicode codepoints from/to GB18030 (from Tatsuya Mizuno)


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25980 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/newline.trans (fun_so_universal_newline): generate \n

2009-11-22T19:15:55+00:00

  after \r\n detection instead of just after \r.
  [ruby-list:45988] [ruby-core:25881] [ruby-core:26788]


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25883 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/big5.c, enc/trans/big5.trans, enc/trans/big5-uao-tbl.rb,

2009-11-17T08:56:11+00:00

  test/ruby/test-transcode.rb: Added Encoding 'Big5-UAO' and transcoding
  for it (from Tatsuya Mizuno) (see Bug #1784)


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@25822 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/big5.trans, big5-hkscs-tbl.rb:

2009-07-24T10:26:18+00:00

  new Chinese BIG5-HKSCS transcoding (with Tatsuya Mizuno)

* test/ruby/test_transcode.rb: added tests for the above
  (with Tatsuya Mizuno)

* enc/big5.c: Added BIG5-HKSCS as a replicate encoding of BIG5
  (short term solution, needs more work; with Tatsuya Mizuno)

* tool/transcode-tblgen.rb: made 'pat' directly accessible in
  class StrSet


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@24264 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/utf8_mac.trans: remove wrong optimization.

2009-06-13T18:55:55+00:00

git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23686 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

Fix: DON'T move in_p because before in_p is replaced by buffered data.

2009-05-05T00:05:11+00:00

* transcode.c: NOMAP is now multibyte direct map.

* transcode.c: remove ASIS.

* transcode_data.h: ditto.

* tool/transcode-tb (ActionMap#generate_info): remove :asis.

* tool/transcode-tb (ActionMap#generate_info): add :nomap0.

* enc/trans/utf8_mac.trans: replace :asis by :nomap0.

git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23344 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/utf8_mac-tbl.rb: don't use Unicode escape.

2009-05-02T01:38:27+00:00

* enc/trans/utf8_mac.trans: follow above.

git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23325 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

* enc/trans/utf8_mac.trans: get rid of a 1.9 feature for cross

2009-04-30T06:27:51+00:00

  compile.


git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23309 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

Add new transcoder: CP51932 <-> CP50221.

2009-04-29T12:50:57+00:00

git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@23307 b2dd03c8-39d4-4d8f-98ff-823fe69b080e