aboutsummaryrefslogtreecommitdiffstats
path: root/enc
Commit message (Collapse)AuthorAgeFilesLines
* * bootstraptest/runner.rb, bootstraptest/test_method.rb, enc/depend,naruse2008-02-121-2/+2
| | | | | | | | instruby.rb, lib/mkmf.rb, lib/test/unit/util/procwrapper.rb, mkconfig.rb, sample/test.rb, template/vm.inc.tmpl, test/ruby/test_stringchar.rb: fixes arround String#gsub. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15443 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/korean.c: add support for CP949 by Park Ji-In. [ruby-dev:33626]naruse2008-02-071-6850/+34924
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15393 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/korean.c: add EUC-KR conversion support by Park Ji-In.naruse2008-02-061-0/+17938
| | | | | | [ruby-dev:33621] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15385 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/*.c: add GB12345, UCS-{2,4}{BE,LE}.naruse2008-01-305-0/+7
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15341 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_16be.c (UTF16_IS_SURROGATE_FIRST): avoid branch.akr2008-01-302-7/+43
| | | | | | | | | | | | | | (UTF16_IS_SURROGATE_SECOND): ditto. (UTF16_IS_SURROGATE): defined. (utf16be_mbc_enc_len): validation implemented. * enc/utf_16le.c (UTF16_IS_SURROGATE_FIRST): avoid branch. (UTF16_IS_SURROGATE_SECOND): ditto. (UTF16_IS_SURROGATE): defined. (utf16le_mbc_enc_len): validation implemented. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15338 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* fix state definition.akr2008-01-291-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15333 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_tw.c (euctw_mbc_enc_len): validation implemented.akr2008-01-291-2/+97
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15331 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_tw.c (euctw_islead): 0x8e is a leading byte.akr2008-01-291-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15323 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/make_transdb.rb: add for make transdb.h.naruse2008-01-291-12/+35
| | | | | | | | | | * dmytranscode.c: add for miniruby. * enc/gbk.c (gbk_left_adjust_char_head, gbk_is_allowed_reverse_match): fix odd regexp match. [ruby-dev:33502] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15321 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * add enc/trans/make_transdb.rb, dmytranscode.cnaruse2008-01-291-0/+40
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15320 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c (rb_to_Windows_31J): to 'Windows-31J'.naruse2008-01-291-1/+1
| | | | | | | | | * common.mk: add rules for transdb.h. * transcode.c (init_transcoder_table): use transdb.h. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15317 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c (EncLen_gbk): too short. [ruby-dev:33497]naruse2008-01-291-0/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15315 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gb18030.c (gb18030_mbc_enc_len): validation implemented.akr2008-01-291-9/+97
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15313 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_kr.c: remove CP949.naruse2008-01-293-13/+12
| | | | | | | | | * enc/euc_cn.c: remove CP936 and rename to gb2312.c * enc/gb2312.c: GB2312 is preferred MIME name. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15309 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c: add GBK, CP936 and CP949.naruse2008-01-292-3/+2
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15308 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c: add GBK, CP936 and CP949.naruse2008-01-291-0/+192
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15307 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_7.h: add dummy encoding UTF-7 and its alias CP65000.naruse2008-01-281-0/+5
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15291 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c: add alias CP65001.usa2008-01-281-0/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15290 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/big5.c (big5_mbc_enc_len): validation implemented.akr2008-01-281-2/+55
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15289 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_kr.c (euckr_mbc_enc_len): validation implemented.akr2008-01-281-2/+55
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15288 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c (rb_from_Windows_31J, rb_to_Windows_31J):nobu2008-01-231-0/+12
| | | | | | | provisional workaround for Windows-31J. [ruby-dev:33320] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15188 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Tue Jan 22 17:52:52 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-221-24/+24
| | | | | | | | | * enc/trans/utf_16_32.c: Streamline parentheses, add more 'static' qualifiers. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15169 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Mon Jan 21 19:42:42 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-211-60/+384
| | | | | | | | | * transcode.c, enc/trans/utf_16_32.c, test/ruby/test_transcode.rb: added UTF-32BE and UTF-32LE conversions. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15156 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_loop, str_transcoding_resize): use unsignednobu2008-01-212-28/+28
| | | | | | | | | | | | | | char. [ruby-dev:33232] * transcode_data.h (rb_transcoding, rb_transcoder): removed callback parameters. * enc/trans/japanese.c: ditto. * enc/trans/utf_16_32.c: parenthesized bit-or operands. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15150 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_dispatch): constified return value.nobu2008-01-202-40/+40
| | | | | | | | | | | | | * transcode_data.h (rb_transcoding): include pointer to rb_transcoder and auxiliary data. * transcode_data.h (rb_transcoder): all callback functions shoud have their own parameters. * enc/trans/{japanese,single_byte}.c: constified. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15148 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Sun Jan 20 20:00:20 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-201-1/+141
| | | | | | | | | | | * transcode.c, enc/trans/utf_16_32.c, test/ruby/test_transcode.rb: added UTF-16LE conversions. * fixed changelog for last commit git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15144 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Sun Jan 20 15:08:08 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-201-0/+332
| | | | | | | | | | | | | | | * enc/trans/utf_16_32.c: new file, currently implementing UTF-16BE conversions only. * test/ruby/test_transcode.rb: Added tests for UTF-16BE; made check_both_ways() use force_encoding differently. * transcode_data.h, transcode.c: Support for more conversion functions. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15142 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/make_encdb.rb: fix duplication check.naruse2008-01-191-10/+11
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15135 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * ascii.c: remove difinition of replica KOI8-U.naruse2008-01-191-2/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15134 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/koi8_u.c: added.naruse2008-01-194-8/+229
| | | | | | | * regenc.c, enc/utf_8.c, enc/unicode.c, enc/gb18030.c: add ARG_UNUSED. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15130 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_cn.c: split from enc/euc_kr.c.nobu2008-01-172-2/+11
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15088 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (encdb.h): give output file name to make_encdb.rb.nobu2008-01-172-40/+49
| | | | | | | | | | | | | | | * encoding.c (enc_table): simplified. * encoding.c (enc_register_at): lazy loading. [ruby-dev:33013] * regenc.h (ENC_DUMMY): added. * enc/make_encdb.rb: now emits macros only. * enc/iso_2022_jp.h: split from encoding.c. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15086 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/shift_jis.c: newline at EOF.nobu2008-01-171-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15082 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/windows_1251.c: newline at EOF.nobu2008-01-161-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15080 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/*: add ARG_UNUSED.naruse2008-01-1523-90/+95
| | | | | | | * enc/koi8_u.c: added. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15069 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_{16,32}{be,le}.c: remove some ARG_UNUSED. replace structnaruse2008-01-154-32/+32
| | | | | | | OnigEncodingST by OnigEncoding. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15068 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * encoding.c (ENC_REGISTER): use &OnigEncoding*.naruse2008-01-1511-60/+41
| | | | | | | | | | | | | (ENCINDEX_UTF_8): renamed from ENCINDEX_UTF8. (rb_enc_init): use ENC_REGISTER. * include/ruby/oniguruma.h (OnigEncodingUTF8, ONIG_ENCODING_UTF8): removed. * enc/*.c: remove use of &encoding_*; use enc argument instead. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15067 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c: remove use of ONIG_ENCODING_UTF8 altogether; usematz2008-01-151-41/+3
| | | | | | enc argument instead. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15066 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c (ONIG_ENCODING_UTF8): reverted.usa2008-01-151-4/+0
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15065 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c (OnigEncodingDefine): encoding name should be keptmatz2008-01-151-1/+1
| | | | | | unchanged. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15063 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/Makefile.in: ditto.nobu2008-01-151-2/+2
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15062 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c: renamed as IANA name.nobu2008-01-151-2/+6
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15061 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * re.c (rb_char_to_option_kcode): use rb_enc_find_index() insteadmatz2008-01-141-1/+1
| | | | | | | | of using fixed index value. * enc/Makefile.in (encsrcdir): make US-ASCII built-in. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15047 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/us_ascii.c: wrong alias name: ANSI_X3.4-1986.matz2008-01-141-2/+2
| | | | | | * rubytest.rb: add -I#{srcdir} to load encoding DLL. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15045 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * encoding.c (rb_locale_encoding): return US-ASCII when charmap is nil.naruse2008-01-142-0/+3
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15039 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Mon Jan 14 10:45:45 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-141-1/+1
| | | | | | | | | * enc/ascii.c: Exchanged order of arguments for one ENC_ALIAS git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15031 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/*.c: add replicas and aliases.naruse2008-01-136-10/+78
| | | | | | | * enc/make_encdb.h: add duplicate and undefined check. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15028 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * define replica encoding "CP949".naruse2008-01-131-0/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15027 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * include/ruby/oniguruma.h: remove ONIG_ENCODING_* and OnigEncoding*naruse2008-01-1310-12/+1368
| | | | | | | | | | | | | which are not builtin. * regenc.{c,h} (onigenc_mb2_code_to_mbclen, onigenc_mb4_code_to_mbclen): fix prototype. * enc/big5.c, enc/euc_kr.c, enc/euc_tw.c, enc/gb18030.c, enc/koi8_r.c, enc/windows_1251.c: imported from Oniguruma. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15026 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/make_encdb.h: sort encoding names by original name.naruse2008-01-1318-5/+41
| | | | | | | * encoding.c, enc/*.c: define replicas and aliases. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15025 b2dd03c8-39d4-4d8f-98ff-823fe69b080e