A parser is simple a class that subclasses RDoc::Parser and implements scan to fill in an RDoc::TopLevel with parsed data.
The initialize method takes an RDoc::TopLevel to fill with parsed content, the name of the file to be parsed, the content of the file, an RDoc::Options object and an RDoc::Stats object to inform the user of parsed items. The scan method is then called to parse the file and must return the RDoc::TopLevel object. By calling super these items will be set for you.
In order to be used by RDoc the parser needs to register the file extensions it can parse. Use ::parse_files_matching to register extensions.
require 'rdoc' class RDoc::Parser::Xyz < RDoc::Parser parse_files_matching %r\.xyz$/ def initialize top_level, file_name, content, options, stats super # extra initialization if needed end def scan # parse file and fill in @top_level end end
Alias an extension to another extension. After this call, files ending "new_ext" will be parsed using the same parser as "old_ext"
# File lib/rdoc/parser.rb, line 50
def self.alias_extension(old_ext, new_ext)
old_ext = old_ext.sub(%r^\.(.*)/, '\1')
new_ext = new_ext.sub(%r^\.(.*)/, '\1')
parser = can_parse "xxx.#{old_ext}"
return false unless parser
RDoc::Parser.parsers.unshift [%r\.#{new_ext}$/, parser]
true
end
Determines if the file is a “binary” file which basically means it has content that an RDoc parser shouldn’t try to consume.
# File lib/rdoc/parser.rb, line 66
def self.binary?(file)
return false if file =~ %r\.(rdoc|txt)$/
s = File.read(file, 1024) or return false
have_encoding = s.respond_to? :encoding
if have_encoding then
return false if s.encoding != Encoding::ASCII_8BIT and s.valid_encoding?
end
return true if s[0, 2] == Marshal.dump('')[0, 2] or s.index("\x00")
if have_encoding then
s.force_encoding Encoding.default_external
not s.valid_encoding?
else
if 0.respond_to? :fdiv then
s.count("\x00-\x7F", "^ -~\t\r\n").fdiv(s.size) > 0.3
else # HACK 1.8.6
(s.count("\x00-\x7F", "^ -~\t\r\n").to_f / s.size) > 0.3
end
end
end
Return a parser that can handle a particular extension
# File lib/rdoc/parser.rb, line 132
def self.can_parse(file_name)
parser = RDoc::Parser.parsers.find { |regexp,| regexp =~ file_name }.last
# HACK Selenium hides a jar file using a .txt extension
return if parser == RDoc::Parser::Simple and zip? file_name
# The default parser must not parse binary files
ext_name = File.extname file_name
return parser if ext_name.empty?
return if parser == RDoc::Parser::Simple and ext_name !~ %rtxt|rdoc/
parser
end
Finds and instantiates the correct parser for the given
file_name
and content
.
# File lib/rdoc/parser.rb, line 150
def self.for top_level, file_name, content, options, stats
return if binary? file_name
parser = use_markup content
unless parser then
# If no extension, look for shebang
if file_name !~ %r\.\w+$/ && content =~ %r{\A#!(.+)} then
shebang = $1
case shebang
when %r{env\s+ruby}, %r{/ruby}
file_name = "dummy.rb"
end
end
parser = can_parse file_name
end
return unless parser
parser.new top_level, file_name, content, options, stats
end
Creates a new Parser storing
top_level
, file_name
, content
,
options
and stats
in instance variables. In
+@preprocess+ an RDoc::Markup::PreProcess object is
created which allows processing of directives.
# File lib/rdoc/parser.rb, line 220
def initialize top_level, file_name, content, options, stats
@top_level = top_level
@top_level.parser = self.class
@file_name = file_name
@content = content
@options = options
@stats = stats
@preprocess = RDoc::Markup::PreProcess.new @file_name, @options.rdoc_include
@preprocess.options = @options
end
Record which file types this parser can understand.
It is ok to call this multiple times.
# File lib/rdoc/parser.rb, line 178
def self.parse_files_matching(regexp)
RDoc::Parser.parsers.unshift [regexp, self]
end
Processes common directives for CodeObjects for the C and Ruby parsers.
Applies directive
‘s value
to
code_object
, if appropriate
# File lib/rdoc/parser.rb, line 97
def self.process_directive code_object, directive, value
warn "RDoc::Parser::process_directive is deprecated and wil be removed in RDoc 4. Use RDoc::Markup::PreProcess#handle_directive instead" if $-w
case directive
when 'nodoc' then
code_object.document_self = nil # notify nodoc
code_object.document_children = value.downcase != 'all'
when 'doc' then
code_object.document_self = true
code_object.force_documentation = true
when 'yield', 'yields' then
# remove parameter &block
code_object.params.sub!(%r,?\s*&\w+/, '') if code_object.params
code_object.block_params = value
when 'arg', 'args' then
code_object.params = value
end
end
If there is a markup: parser_name
comment at the front of the
file, use it to determine the parser. For example:
# markup: rdoc # Class comment can go here class C end
The comment should appear as the first line of the content
.
If the content contains a shebang or editor modeline the comment may appear on the second or third line.
Any comment style may be used to hide the markup comment.
# File lib/rdoc/parser.rb, line 199
def self.use_markup content
markup = content.lines.first(3).grep(%rmarkup:\s+(\w+)/) { $1 }.first
return unless markup
# TODO Ruby should be returned only when the filename is correct
return RDoc::Parser::Ruby if %w[tomdoc markdown].include? markup
markup = Regexp.escape markup
RDoc::Parser.parsers.find do |_, parser|
%r^#{markup}$/ =~ parser.name.sub(%r.*:/, '')
end.last
end
Checks if file
is a zip file in disguise. Signatures from www.garykessler.net/library/file_sigs.html
# File lib/rdoc/parser.rb, line 121
def self.zip? file
zip_signature = File.read file, 4
zip_signature == "PK\x03\x04" or
zip_signature == "PK\x05\x06" or
zip_signature == "PK\x07\x08"
end
/ | Search |
---|---|
? | Show this help |