summaryrefslogtreecommitdiffstats
path: root/ext/ripper
diff options
context:
space:
mode:
authoraamine <aamine@b2dd03c8-39d4-4d8f-98ff-823fe69b080e>2004-09-20 07:59:30 +0000
committeraamine <aamine@b2dd03c8-39d4-4d8f-98ff-823fe69b080e>2004-09-20 07:59:30 +0000
commit6834045fc5d4b303947fbc5423e6601177886e6e (patch)
treec22c02a0c7bf687e952da4055502f0b6c34870ff /ext/ripper
parent2686a5dc79807e1c8adac782688e21c0b961a1f8 (diff)
downloadruby-6834045fc5d4b303947fbc5423e6601177886e6e.tar.gz
ruby-6834045fc5d4b303947fbc5423e6601177886e6e.tar.xz
ruby-6834045fc5d4b303947fbc5423e6601177886e6e.zip
* parse.y [ripper]: do not delay dispatching.
* ext/ripper/lib/ripper/tokenizer.rb: sort tokens by right order. git-svn-id: http://svn.ruby-lang.org/repos/ruby/trunk@6936 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
Diffstat (limited to 'ext/ripper')
-rw-r--r--ext/ripper/lib/ripper/tokenizer.rb6
1 files changed, 4 insertions, 2 deletions
diff --git a/ext/ripper/lib/ripper/tokenizer.rb b/ext/ripper/lib/ripper/tokenizer.rb
index 0bd966ea5..134de9d1e 100644
--- a/ext/ripper/lib/ripper/tokenizer.rb
+++ b/ext/ripper/lib/ripper/tokenizer.rb
@@ -24,11 +24,13 @@ class Ripper
def tokenize
@tokens = []
parse
- @tokens
+ @tokens.sort_by {|tok, pos| pos }.map {|tok,| tok }
end
+ private
+
def on__scan(type, tok)
- @tokens.push tok
+ @tokens.push [tok, [lineno(),column()]]
end
end