Skip to content

Commit 06bd60d

Browse files
kkawamu1awebson
kkawamu1
and
awebson
authored
Add GEM/xsum prompts (#745)
* Add GEM/xsum prompts * uncommit this hack * Add GEM in INCLUDED_USERS Co-authored-by: Albert Webson <[email protected]>
1 parent c25d5c1 commit 06bd60d

File tree

2 files changed

+159
-1
lines changed

2 files changed

+159
-1
lines changed

‎promptsource/templates.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@
2626

2727
# These are users whose datasets should be included in the results returned by
2828
# filter_english_datasets (regardless of their metadata)
29-
INCLUDED_USERS = {"Zaid", "craffel"}
29+
INCLUDED_USERS = {"Zaid", "craffel", "GEM"}
3030

3131

3232
def highlight(input):

‎promptsource/templates/GEM/xsum/templates.yaml

Lines changed: 158 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,158 @@
1+
dataset: GEM/xsum
2+
templates:
3+
019726f2-7140-4ab6-a18d-a5f9cc709a47: !Template
4+
answer_choices: null
5+
id: 019726f2-7140-4ab6-a18d-a5f9cc709a47
6+
jinja: 'Summarize: {{document}} ||| {{target}}'
7+
metadata: !TemplateMetadata
8+
choices_in_prompt: false
9+
metrics:
10+
- ROUGE
11+
- BLEU
12+
original_task: true
13+
name: summarize_DOC
14+
reference: ''
15+
2b9c75ca-2848-4a63-b3ce-b86ea2e2d7e8: !Template
16+
answer_choices: null
17+
id: 2b9c75ca-2848-4a63-b3ce-b86ea2e2d7e8
18+
jinja: '{{document}}
19+
20+
This boils down to the simple idea that ||| {{target}}'
21+
metadata: !TemplateMetadata
22+
choices_in_prompt: false
23+
metrics:
24+
- ROUGE
25+
- BLEU
26+
original_task: true
27+
name: DOC_boils_down_to_simple_idea_that
28+
reference: ''
29+
463de7e7-7ead-42ac-9c32-97ded6636940: !Template
30+
answer_choices: null
31+
id: 463de7e7-7ead-42ac-9c32-97ded6636940
32+
jinja: '{{document}}
33+
34+
How would you rephrase that in a few words? ||| {{target}}'
35+
metadata: !TemplateMetadata
36+
choices_in_prompt: false
37+
metrics:
38+
- ROUGE
39+
- BLEU
40+
original_task: true
41+
name: DOC_how_would_you_rephrase_few_words
42+
reference: ''
43+
7d3584c5-8864-4d11-bce9-65499cdef4cb: !Template
44+
answer_choices: null
45+
id: 7d3584c5-8864-4d11-bce9-65499cdef4cb
46+
jinja: 'Summarize this document: {{document}}
47+
48+
Summary: ||| {{target}}'
49+
metadata: !TemplateMetadata
50+
choices_in_prompt: false
51+
metrics:
52+
- ROUGE
53+
- BLEU
54+
original_task: true
55+
name: summarize_this_DOC_summary
56+
reference: ''
57+
88bc4152-7ddb-4624-bff4-3c9ec27d302f: !Template
58+
answer_choices: null
59+
id: 88bc4152-7ddb-4624-bff4-3c9ec27d302f
60+
jinja: 'My college roommate asked me what this article means:
61+
62+
63+
{{document}}
64+
65+
66+
So I recapped it in layman''s terms: ||| {{target}}'
67+
metadata: !TemplateMetadata
68+
choices_in_prompt: false
69+
metrics:
70+
- ROUGE
71+
- BLEU
72+
original_task: true
73+
name: college_roommate_asked_DOC_so_I_recap
74+
reference: ''
75+
a8d4ecfa-c944-44d5-878c-04fd5db59e64: !Template
76+
answer_choices: null
77+
id: a8d4ecfa-c944-44d5-878c-04fd5db59e64
78+
jinja: 'Article: {{document}}
79+
80+
81+
Summary: ||| {{target}}'
82+
metadata: !TemplateMetadata
83+
choices_in_prompt: false
84+
metrics:
85+
- ROUGE
86+
- BLEU
87+
original_task: true
88+
name: article_DOC_summary
89+
reference: Prefix-Tuning
90+
cc0096ea-e9db-4e96-85b4-0740085fee55: !Template
91+
answer_choices: null
92+
id: cc0096ea-e9db-4e96-85b4-0740085fee55
93+
jinja: '{{document}}
94+
95+
96+
===
97+
98+
99+
Given the above document, write one sentence to summarize: ||| {{target}}'
100+
metadata: !TemplateMetadata
101+
choices_in_prompt: false
102+
metrics:
103+
- ROUGE
104+
- BLEU
105+
original_task: true
106+
name: DOC_given_above_write_one_sentence
107+
reference: ''
108+
d30a36f0-0055-41b4-8658-82c72c1b77a9: !Template
109+
answer_choices: null
110+
id: d30a36f0-0055-41b4-8658-82c72c1b77a9
111+
jinja: '{{document}}
112+
113+
114+
===
115+
116+
117+
Write a summary of the text above : ||| {{target}}'
118+
metadata: !TemplateMetadata
119+
choices_in_prompt: false
120+
metrics:
121+
- ROUGE
122+
- BLEU
123+
original_task: true
124+
name: DOC_write_summary_of_above
125+
reference: ''
126+
d84cc995-795e-406f-ad82-1eab79cc4f81: !Template
127+
answer_choices: null
128+
id: d84cc995-795e-406f-ad82-1eab79cc4f81
129+
jinja: 'First, please read the article below.
130+
131+
132+
{{document}}
133+
134+
135+
Now, can you write me an extremely short abstract for it? ||| {{target}}'
136+
metadata: !TemplateMetadata
137+
choices_in_prompt: false
138+
metrics:
139+
- ROUGE
140+
- BLEU
141+
original_task: true
142+
name: read_below_DOC_write_abstract
143+
reference: ''
144+
db54e9b5-8ca9-4266-a773-695a3dc5bbf4: !Template
145+
answer_choices: null
146+
id: db54e9b5-8ca9-4266-a773-695a3dc5bbf4
147+
jinja: '{{document}}
148+
149+
150+
TL;DR: ||| {{target}}'
151+
metadata: !TemplateMetadata
152+
choices_in_prompt: false
153+
metrics:
154+
- ROUGE
155+
- BLEU
156+
original_task: true
157+
name: DOC_tldr
158+
reference: GPT-2 TLDR

0 commit comments

Comments
 (0)